-- Logs begin at Mon 2022-05-16 18:09:35 UTC, end at Mon 2022-05-16 19:26:34 UTC. -- May 16 18:59:12.343824 dv-cinder-766064-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 18:59:12.353356 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 18:59:12.355398 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 18:59:12 2022] *** May 16 18:59:12.355398 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 18:59:12.355398 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 18:59:12.355398 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: nodename: dv-cinder-766064-6-iscsi May 16 18:59:12.355398 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: machine: x86_64 May 16 18:59:12.355398 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: clock source: unix May 16 18:59:12.355398 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: pcre jit disabled May 16 18:59:12.355398 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: detected number of CPU cores: 4 May 16 18:59:12.355398 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: current working directory: / May 16 18:59:12.355398 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: detected binary path: /usr/bin/uwsgi-core May 16 18:59:12.355398 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: your processes number limit is 47680 May 16 18:59:12.355398 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: your memory page size is 4096 bytes May 16 18:59:12.355398 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: detected max file descriptor number: 2048 May 16 18:59:12.355398 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: lock engine: pthread robust mutexes May 16 18:59:12.356380 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: thunder lock: enabled May 16 18:59:12.356380 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 18:59:12.356380 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 18:59:12.399767 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: Python main interpreter initialized at 0x55fac48a29c0 May 16 18:59:12.399767 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: python threads support enabled May 16 18:59:12.399767 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: your server socket listen backlog is limited to 100 connections May 16 18:59:12.399767 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: your mercy for graceful operations on workers is 90 seconds May 16 18:59:12.400133 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: mapped 403077 bytes (393 KB) for 2 cores May 16 18:59:12.400210 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: *** Operational MODE: preforking *** May 16 18:59:12.400441 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: *** uWSGI is running in multiple interpreter mode *** May 16 18:59:12.400441 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: spawned uWSGI master process (pid: 102932) May 16 18:59:12.400654 dv-cinder-766064-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 18:59:12.403016 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: spawned uWSGI worker 1 (pid: 102933, cores: 1) May 16 18:59:12.403016 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: spawned uWSGI worker 2 (pid: 102934, cores: 1) May 16 18:59:12.403016 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 18:59:13.574857 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 18:59:13.575467 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 18:59:14.296760 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:59:14.296760 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: from cryptography.utils import int_from_bytes May 16 18:59:14.297093 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:59:14.297093 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: from cryptography.utils import int_from_bytes May 16 18:59:14.302293 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:59:14.302293 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: from cryptography.utils import int_from_bytes May 16 18:59:14.302619 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:59:14.302619 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: from cryptography.utils import int_from_bytes May 16 18:59:16.868899 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 18:59:16.869507 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 18:59:16.869652 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 18:59:16.869652 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 18:59:16.870042 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 18:59:16.870042 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 18:59:16.870176 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 18:59:16.870243 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 18:59:16.870473 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 18:59:16.870671 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.870803 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 18:59:16.870980 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.871133 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.871326 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.871469 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.871603 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.871753 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.871968 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.872110 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.872283 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.872415 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.872601 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.872768 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.872898 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.872999 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.873261 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.873393 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.873495 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.873664 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.873852 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.873995 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.874178 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-766064-6-iscsi {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.874310 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.874499 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.874645 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-766064-6-iscsi {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.874805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.874954 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.875121 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.875263 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.875419 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.875517 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.875702 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.875792 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.876029 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.876129 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.876348 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.876446 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.876728 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.876869 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.878076 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.878241 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.878360 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.878489 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.878622 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.878749 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.878875 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.879004 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.879134 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.879261 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.879371 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.879493 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.879633 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.879839 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.879972 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.880093 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.880225 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.880353 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.880484 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.880604 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.880723 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.880850 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-766064-6-iscsi {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.880971 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-766064-6-iscsi {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.881090 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.881201 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.881325 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.881453 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.881627 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.881756 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.881876 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.882046 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.882189 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.882367 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.882492 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.882673 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.882806 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.882996 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.883130 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.883310 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.883430 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.883614 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.883740 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.883937 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.884065 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.884258 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.884391 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.884574 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.884713 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.884871 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.884998 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.885186 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.885312 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.885495 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.885673 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.885803 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.885922 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.886125 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.886256 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.886414 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.886621 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.886758 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.886885 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.887005 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.887131 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.887264 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.887384 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.887576 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.887704 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.887902 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.888039 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.888179 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.888302 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.888424 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.888546 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.888666 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.888795 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.889004 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.889131 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.889315 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.889442 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.889616 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.889753 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.889941 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.890065 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.890248 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.890380 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.890543 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.890676 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.890857 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.890983 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.891156 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.891290 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.891450 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.891575 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.891764 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.891900 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.892086 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.892211 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.892400 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.892525 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.892712 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.892837 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.893021 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.893155 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.893381 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.893509 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.893747 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.893885 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.894057 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.894190 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.894369 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.894497 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.894692 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.894819 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.895008 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.895148 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.895319 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.895454 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.895639 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.895772 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.895934 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.896069 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.896271 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.896401 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.896522 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.896713 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.896843 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.896974 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.897138 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.897349 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.897480 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.897640 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.897763 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.897892 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.898014 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.898145 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.898297 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.898424 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.898621 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.898754 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.899018 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.899145 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.899417 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.899548 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.899728 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.900036 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.900157 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.900338 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.900597 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.900723 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.900941 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.901169 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.901296 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.901577 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.901780 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.901908 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.902529 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.902709 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.902842 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.903133 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.903260 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.903444 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.903762 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.903887 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.904091 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.904402 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.904541 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.904674 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.904935 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.905062 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.905289 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.905477 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.905625 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.905975 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.906105 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.906382 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.906515 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.906772 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.906905 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.907040 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.907381 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.907507 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.907708 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.907903 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.908030 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.908316 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.908452 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.908706 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.908909 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.909137 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.909359 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.909496 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.909840 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.909979 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.910162 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.910394 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.910537 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.910796 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.910923 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.911195 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.911323 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.911505 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.911640 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.911806 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.911934 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.912122 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.912249 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.912432 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.912569 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.912718 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.912848 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.913043 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.913165 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.913360 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.913499 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.913701 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.913825 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.914017 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.914140 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.914324 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.914455 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.914631 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.914754 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.914951 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.915076 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.915253 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.915390 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.915563 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.915687 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.915872 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.916003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.916181 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.916306 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.916511 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.916641 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.916811 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.916997 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.917132 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.917253 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.917432 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.917579 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.917778 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.917919 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.918089 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.918219 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.918413 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:59:16.918537 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.918755 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.918887 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.919099 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.919229 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.919435 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.919556 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.919755 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.919895 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.920078 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.920200 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.920400 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.920522 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.920722 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.920857 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.921035 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.921166 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.921351 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.921495 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.921707 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.921848 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.922026 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.922150 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.922336 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.922458 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.922653 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.922784 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.922976 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.923100 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.923301 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.923423 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.923626 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.923759 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.923949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.924079 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.924263 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.924494 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.924633 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.924764 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.924934 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.925081 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.925260 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.925413 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.925622 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.925773 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.925942 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.926100 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.926264 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.926416 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.926572 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.926759 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.926882 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.927101 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.927246 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.927417 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.927613 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.927747 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.927935 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.928067 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.928336 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.928461 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.928655 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.928778 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.928969 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.929106 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.929284 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.929488 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.929661 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.929790 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.929947 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.930071 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.930274 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.930408 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.930590 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.930749 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.930907 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.931093 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.931226 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.931408 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.931537 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.931776 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.931900 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.932049 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.932160 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.932443 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.932530 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.932764 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.932855 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.933079 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.933173 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.933400 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.933603 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.933740 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.933869 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.934045 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.934178 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.934357 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.934491 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.934667 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.934790 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.934973 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.935115 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.935281 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.935403 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.935593 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.935726 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.935900 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.936037 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.936222 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.936338 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.936551 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.936685 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.936886 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.937019 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.937163 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.937353 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.937485 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.937639 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.937804 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.937938 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.938116 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.938258 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.938425 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.938555 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.938729 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.938861 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.939042 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.939163 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.939353 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.939481 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.939660 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.939784 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.940089 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.940210 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.940409 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.940576 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.940700 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.940925 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.941060 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.941287 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.941420 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.941633 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.941769 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.941952 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.942076 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.942262 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.942386 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.942572 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.942696 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.942890 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.943014 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.943199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.943324 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.943524 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.943648 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.943838 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.943962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.944145 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.944281 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.944453 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.944585 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.944766 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.944890 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.945075 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.945209 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.945384 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.945517 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.945720 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.945844 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.946029 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.946174 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.946332 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.946454 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.946643 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.946779 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.946978 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.947117 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.947240 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.947375 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.947563 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.947690 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.947810 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.947942 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.948116 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.948238 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.948419 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.948543 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.948723 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.948856 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.949027 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.949150 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.949330 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.949464 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.949737 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.949870 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.950051 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.950175 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.950355 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.950478 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.950659 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.950784 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.950963 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.951087 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.951272 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.951393 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.951584 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.951709 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.951904 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.952027 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.952215 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.952348 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.952534 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.952657 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.952843 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.952976 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.953163 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.953294 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.953470 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.953641 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.953807 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.953937 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.954108 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.954240 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.954419 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.954541 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.954730 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.954854 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.955051 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.955184 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.955362 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.955486 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.955737 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.955868 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.956066 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.956189 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.956383 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.956506 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.956692 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.956814 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.957000 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.957196 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.957319 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.957437 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.957639 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.957769 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.957944 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.958079 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.958253 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.958387 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.958568 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.958702 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.958903 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.959026 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.959180 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.959313 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.959486 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.959610 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.959826 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.959953 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.960131 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.960254 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.960448 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.960586 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.960757 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.960881 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.961077 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.961200 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.961383 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.961519 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.961714 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.961843 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.962019 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.962141 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.962326 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.962458 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.962635 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.962757 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.962940 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.963084 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.963242 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.963380 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.963543 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.963659 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.963846 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.963979 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.964155 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.964287 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.964462 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.964585 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.964769 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.964901 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.965071 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.965196 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.965382 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.965505 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.965712 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.965835 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.966012 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.966139 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.966312 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.966445 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.966614 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.966735 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.966921 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.967055 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.967256 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.967385 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.967531 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.967664 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.967860 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.967983 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.968129 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.968253 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.968425 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.968557 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.968736 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.968857 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.969039 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.969172 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.969338 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.969470 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.969656 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.969773 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.969952 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.970076 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.970272 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.970403 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.970587 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.970708 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.970888 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.971010 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.971191 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.971343 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.971551 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.971674 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.971865 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.971985 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.972174 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.972305 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.972475 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.972605 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.972781 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.972915 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.973079 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.973202 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.973396 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.973548 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.973725 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.973848 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.974033 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.974174 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.974338 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.974462 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.974644 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.974781 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.974949 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.975072 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.975256 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.975377 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.975562 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.975695 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.975866 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.975988 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.976171 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.976292 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.976471 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.976604 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.976777 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.976900 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.977081 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.977202 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.977406 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.977673 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.977801 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.977997 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.978119 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.978313 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.978451 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.978621 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.978745 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.978931 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.979062 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.979241 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.979379 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.979543 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.979667 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.979852 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.979975 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.980170 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.980302 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.980510 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.980736 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.980875 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.981070 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.981194 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.981384 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.981544 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.981715 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.981852 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.982019 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.982151 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.982319 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.982458 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.982617 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.982749 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.982925 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.983048 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.983225 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.983358 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.983525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.983660 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.983825 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.983950 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.984129 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.984261 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.984440 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.984573 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.984740 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.984871 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.985048 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.985170 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.985348 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.985472 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.985674 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.985809 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.985984 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.986115 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.986284 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.986408 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.986584 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.986713 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.986886 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.987023 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.987213 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.987334 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.987531 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.987670 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.987817 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.987949 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.988162 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.988288 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.988416 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.988536 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.988723 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.988848 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.989032 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.989157 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.989335 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.989459 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.989663 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.989792 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.989965 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.990087 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.990268 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.990391 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.990584 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.990709 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.990891 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.991014 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.991190 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.991314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.991498 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.991623 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.991806 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.991930 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.992113 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.992247 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.992419 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.992551 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.992721 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.992854 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.993025 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.993162 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.993326 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.993450 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.993660 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.993786 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.993964 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.994095 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.994266 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.994388 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.994565 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.994689 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.994871 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.995003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.995173 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.995302 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.995472 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.995602 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.995773 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.995896 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.996070 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.996192 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.996370 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.996491 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.996671 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.996806 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.996974 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.997099 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.997272 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.997399 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.997611 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.997746 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.997903 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.998028 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.998222 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.998350 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.998486 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.998615 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.998794 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.998919 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.999094 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.999227 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.999392 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.999517 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.999695 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.999819 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:16.999994 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.000127 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.000297 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.000414 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.000598 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.000723 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.000904 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.001043 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.001208 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.001331 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.001503 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.001662 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.001837 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.001979 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.002138 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.002262 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.002438 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.002604 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.002797 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.002922 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.003099 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.003220 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.003395 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.003526 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.003693 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.003818 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.003990 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.004113 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.004287 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.004419 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.004587 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.004720 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.004897 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.005019 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.005201 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.005332 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.005499 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.005647 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.005823 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.005947 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.006121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.006253 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.006420 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.006551 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.006723 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.006851 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.007024 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.007158 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.007326 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.007450 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.007628 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.007827 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.007958 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.008090 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.008244 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.008441 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.008563 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.008682 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.008836 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.008974 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.009130 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.009252 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.009444 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.009600 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.009775 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.009900 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.010085 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.010210 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.010387 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.010511 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.010681 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.010804 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.010988 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.011120 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.011294 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.011417 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.011600 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.011725 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.011909 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.012030 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.012212 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.012336 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.012526 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.012650 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.012826 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.012949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.013130 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.013253 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.013429 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.013587 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.013756 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.013881 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.014075 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.014205 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.014383 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.014507 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.014692 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.014815 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.015010 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.015141 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.015317 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.015441 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.015624 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.015747 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.015931 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.016065 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.016234 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.016364 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.016536 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.016659 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.016841 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.016976 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.017140 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.017264 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.017445 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.017611 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.017827 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.018018 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.018231 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.018383 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.018621 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.018752 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.018892 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.019018 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.019142 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.019273 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.019396 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.019517 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.019652 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.019775 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.019941 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.020064 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.020185 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.020321 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.020462 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.020594 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.020794 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.020974 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.021107 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.021248 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.021376 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.021498 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.021663 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.021791 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.022004 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.022199 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.022345 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.022473 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.022726 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.022909 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.023043 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.023183 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.023319 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.023444 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.023565 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.023685 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.023891 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.024085 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.024220 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.024345 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.024467 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.024601 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.024808 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.024946 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.025070 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.025192 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.025313 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.025509 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.025767 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.025907 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.026033 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.026193 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.026325 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.026529 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.026729 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.026866 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.027355 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.027491 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.027615 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.027737 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.028096 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.028284 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.028435 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.028566 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.028772 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.028910 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.029044 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.029182 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.029312 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.029435 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.029598 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.029734 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.029866 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.029989 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.030111 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.030241 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.030371 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.030652 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.030780 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.030903 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.031035 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.031264 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.031445 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.031623 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.031763 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.031899 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.032023 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.032154 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.032279 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.032479 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.032659 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.032808 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.032935 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.033069 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.033195 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.033394 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.033628 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.033769 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.033960 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.034086 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.034208 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.034408 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.034602 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.034747 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.034874 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.034998 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.035119 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.035289 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.035503 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.035630 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.035754 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.035959 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.036147 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.036284 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.036429 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.036555 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.036678 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.036809 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.036933 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.037141 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.037321 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.037456 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.037629 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.037766 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.037891 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.038025 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.038167 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.038337 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.038464 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.038592 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.038826 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.038981 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.039114 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.039237 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.039358 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.039479 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.039683 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.039878 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.040015 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.040141 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.040263 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.040385 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.040592 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.040878 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.041020 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.041148 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.041271 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.041402 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.041587 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.041715 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.041837 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.041958 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.042080 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.042224 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.042360 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.042493 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.042706 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.042887 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.043021 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.043146 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.043286 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.043411 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.043634 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.043816 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.043950 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.044096 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.044222 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.044354 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.044514 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.044645 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.044845 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.045040 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.045177 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.045303 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.045425 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.045589 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.045790 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.045986 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.046122 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.046248 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.046382 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.046505 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.046626 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.046759 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.046931 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.047073 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.047232 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.047364 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.047521 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.047650 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.047848 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.048030 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.048163 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.048301 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.048438 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.048564 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.048686 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.048843 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.049071 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.049205 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.049344 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.049469 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.049641 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.049766 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.049924 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.050074 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.050209 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.050368 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.050578 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.050758 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.050994 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.051143 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.051279 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.051395 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.051516 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.051646 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.051784 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.051917 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.052078 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.052211 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.052404 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.052584 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.052718 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.052861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.052988 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.053122 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.053329 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.053509 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.053669 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.053822 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.053949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.054071 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.054232 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.054363 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.054533 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.054664 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.054865 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.055044 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.055177 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.055306 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.055449 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.055575 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.055742 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.055875 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.056072 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.056252 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.056408 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.056539 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.056665 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.056892 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.057071 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.057205 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.057347 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.057473 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.057641 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.057807 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.057940 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.058110 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.058243 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.058450 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.058630 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.058809 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.058939 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.059099 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.059305 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.059445 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.059570 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.059692 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.059814 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.059945 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.060227 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.060407 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.060556 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.060752 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.060891 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.061110 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.061251 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.061376 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.061498 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.061646 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.061785 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.061909 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.062041 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.062163 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.062330 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.062463 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.062670 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.062851 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.062984 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.063123 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.063249 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.063455 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.063582 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.063706 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.063873 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.064004 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.064196 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.064398 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.064535 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.064653 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.064775 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.064897 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.065095 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.065226 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.065425 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.065656 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.065797 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.065925 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.066060 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.066185 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.066310 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.066433 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.066660 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.066854 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.067002 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.067130 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.067264 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.067388 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.067585 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.067779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.067918 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.068055 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.068181 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.068312 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.068544 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.068685 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.068851 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.068993 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.069167 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.069316 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.069519 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.069706 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.069831 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.069945 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.070066 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.070243 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.070382 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.070560 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.070689 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.070873 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.071011 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.071150 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.071354 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.071489 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.071613 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.071735 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.071940 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.072071 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.072321 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.072450 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.072635 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.072772 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.072931 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.073063 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.073248 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.073377 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.073574 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.073735 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.073864 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.074067 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.074385 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.074521 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.074715 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.074878 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.075006 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.075138 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.075313 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.075450 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.075639 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.075768 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.075971 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.076107 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.076285 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.076423 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.076595 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.076732 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.076885 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.077032 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.077163 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.077295 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.077488 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.077656 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.077791 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.077914 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.078101 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.078342 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.078473 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.078683 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.078822 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.078953 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.079074 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.079265 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.079395 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.079540 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.079739 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.079875 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.079997 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.080150 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.080282 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.080468 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.080657 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.080786 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.080908 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.081283 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.081494 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.081710 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.081837 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.081959 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.082081 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.082202 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.082323 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.082454 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.082578 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.082699 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.082829 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.082960 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.083091 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.083222 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.083345 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.083473 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.083604 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.083733 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.083855 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.083985 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.084183 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.084310 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.084499 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.084626 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.084824 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.084954 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.085100 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.085226 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.085412 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.085563 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.085744 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.085871 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.086046 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.086178 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.086349 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.086472 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.086652 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.086780 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.086954 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.087078 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.087257 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.087380 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.087564 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.087698 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.087867 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.087993 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.088177 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.088398 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.088525 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.088726 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.088853 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.089043 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.089176 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.089371 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.089498 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.089787 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.089935 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.090060 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.090189 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.090326 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.090447 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.090608 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.090733 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.090918 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.091045 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.091224 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.091349 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.091559 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.091689 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.091811 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.092012 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.092127 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.092248 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.092409 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.092690 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.092817 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.093004 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.093131 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.093308 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.093433 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.093646 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.093773 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.093950 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.094080 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.094255 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.094382 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.094559 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.094694 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.094859 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.094975 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.095184 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.095310 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.095494 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.095630 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.095805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.095931 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.096111 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.096235 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.096483 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.096625 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.096792 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.096917 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.097101 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.097228 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.097407 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.097555 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.097736 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.097871 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.098069 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.098197 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.098330 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.098453 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.098642 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.098775 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.098945 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.099139 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.099357 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.099484 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.099666 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.099801 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.100010 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.100151 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.100276 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.100408 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.100578 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.100705 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.100895 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.101031 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.101211 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.101337 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.101516 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.101771 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.101899 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.102035 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.102167 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.102337 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.102473 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.102660 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.102786 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.102991 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.103119 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.103307 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.103433 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.103614 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.103753 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.103962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.104095 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.104260 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.104386 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.104564 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.104706 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.104875 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.105000 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.105177 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.105310 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.105474 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.105668 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.105803 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.105928 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.106086 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.106211 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.106384 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.106520 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.106680 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.106805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.106979 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.107177 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.107315 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.107439 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.107570 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.107739 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.107865 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.108065 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.108207 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.108371 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.108506 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.108674 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.108808 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.108982 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.109108 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.109280 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.109405 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.109618 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.109745 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.109948 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.110162 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.110287 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.110408 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.110545 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.110671 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.110803 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.110925 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.111099 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.111225 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.111398 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.111530 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.111703 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.111929 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.112056 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.112177 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.112333 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.112484 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.112639 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.112768 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.112941 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.113068 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.113243 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.113383 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.113582 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.113713 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.113880 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.114009 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.114183 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.114318 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.114485 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.114609 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.114785 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.114917 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.115078 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.115266 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.115399 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.115541 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.115665 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.115779 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.118544 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.118697 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.118697 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.118898 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.119061 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.119178 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.119296 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.119403 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.119507 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.119611 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.119714 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.119818 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.119932 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.120038 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.120169 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.120355 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.120465 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.120581 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.120687 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.120790 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.120894 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.121018 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.121139 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.121269 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.121400 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.121522 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.121682 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.121803 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.121939 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.122213 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.122344 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.122456 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.122577 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.122703 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.122834 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.122967 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.123098 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.123229 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.123351 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.123484 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.123621 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.123752 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.123874 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.124002 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.124138 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.124259 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.124388 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.124510 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.124638 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.124760 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.124881 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.125003 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.125138 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.125252 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.125380 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.125504 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.125646 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.125782 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.125906 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.126037 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.126159 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.126280 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.126401 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 18:59:17.126532 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.126532 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.126532 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.126532 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.126973 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.127093 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.127340 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.127736 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.128068 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.128416 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.128730 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.129078 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.129407 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.129748 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.130065 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.130398 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:59:17.130610 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 18:59:17.148829 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:59:17.153498 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG oslo_db.sqlalchemy.engines [None req-be770533-a106-4176-9eee-a7e38a5655d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:59:17.212749 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.context [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f(cell1) {{(pid=102933) load_cells /opt/stack/nova/nova/context.py:464}} May 16 18:59:17.217086 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:17.217252 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.context [None req-be770533-a106-4176-9eee-a7e38a5655d7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f(cell1) {{(pid=102934) load_cells /opt/stack/nova/nova/context.py:464}} May 16 18:59:17.218690 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:17.219469 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:17.221492 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:17.221661 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG oslo_concurrency.lockutils [None req-be770533-a106-4176-9eee-a7e38a5655d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:17.223214 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG oslo_concurrency.lockutils [None req-be770533-a106-4176-9eee-a7e38a5655d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:17.224012 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG oslo_concurrency.lockutils [None req-be770533-a106-4176-9eee-a7e38a5655d7 None None] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 18:59:17.226063 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG oslo_concurrency.lockutils [None req-be770533-a106-4176-9eee-a7e38a5655d7 None None] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 18:59:17.232541 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:59:17.236544 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:59:17.240341 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG oslo_db.sqlalchemy.engines [None req-be770533-a106-4176-9eee-a7e38a5655d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:59:17.243617 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG oslo_db.sqlalchemy.engines [None req-be770533-a106-4176-9eee-a7e38a5655d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:59:17.398228 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:59:17.402849 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG oslo_db.sqlalchemy.engines [None req-be770533-a106-4176-9eee-a7e38a5655d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:59:17.738492 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: WARNING keystonemiddleware.auth_token [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 18:59:17.740672 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: WARNING keystonemiddleware.auth_token [None req-be770533-a106-4176-9eee-a7e38a5655d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 18:59:17.746849 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: WARNING keystonemiddleware.auth_token [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 18:59:17.748034 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: WARNING keystonemiddleware.auth_token [None req-be770533-a106-4176-9eee-a7e38a5655d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 18:59:18.094695 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: WARNING keystonemiddleware.auth_token [None req-be770533-a106-4176-9eee-a7e38a5655d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 18:59:18.096135 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: WARNING keystonemiddleware.auth_token [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 18:59:18.100937 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: WARNING keystonemiddleware.auth_token [None req-be770533-a106-4176-9eee-a7e38a5655d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 18:59:18.102382 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: WARNING keystonemiddleware.auth_token [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 18:59:18.107083 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fac48a29c0 pid: 102934 (default app) May 16 18:59:18.108453 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fac48a29c0 pid: 102933 (default app) May 16 18:59:18.109164 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-be770533-a106-4176-9eee-a7e38a5655d7 None None] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 18:59:18.110423 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-be770533-a106-4176-9eee-a7e38a5655d7 None None] 10.222.0.24 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001790 May 16 18:59:18.110819 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 788 bytes} [Mon May 16 18:59:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:00:35.760564 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:35.761822 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002115 May 16 19:00:35.762388 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 1/2] 10.222.0.24 () {54 vars in 930 bytes} [Mon May 16 19:00:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:00:36.192222 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-9d38efff-f8d3-4b73-8524-d829d8668717 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:36.221222 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-9d38efff-f8d3-4b73-8524-d829d8668717 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.452701 May 16 19:00:36.221960 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 2/3] 10.222.0.24 () {60 vars in 1291 bytes} [Mon May 16 19:00:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:38.488772 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:38.490450 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-dcb097cb-f3d2-442f-bbff-cc5ca045a7e1 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002111 May 16 19:00:38.492157 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 2/4] 10.222.0.24 () {54 vars in 930 bytes} [Mon May 16 19:00:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:00:38.550502 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-4c80a8d6-eb2d-4c50-ae97-6afa71e0a42f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0, "name": "cirros256"}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:38.569061 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 19:00:38.569061 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: warnings.warn(msg) May 16 19:00:38.600088 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-4c80a8d6-eb2d-4c50-ae97-6afa71e0a42f admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103273 May 16 19:00:38.600746 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 3/5] 10.222.0.24 () {64 vars in 1282 bytes} [Mon May 16 19:00:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:00:38.812650 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-e4ca40bf-face-4f6b-8c52-9a17ac613b93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:38.815186 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 19:00:38.815186 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: warnings.warn(msg) May 16 19:00:38.863191 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-e4ca40bf-face-4f6b-8c52-9a17ac613b93 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.253918 May 16 19:00:38.868699 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 3/6] 10.222.0.24 () {64 vars in 1335 bytes} [Mon May 16 19:00:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:41.131467 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-4c80a8d6-eb2d-4c50-ae97-6afa71e0a42f admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:41.132448 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-4c80a8d6-eb2d-4c50-ae97-6afa71e0a42f admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 May 16 19:00:41.132845 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 4/7] 10.222.0.24 () {54 vars in 930 bytes} [Mon May 16 19:00:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:00:41.243267 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-2aa9e716-cf42-4ff0-a43e-c6e828b2fc6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:41.260879 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 19:00:41.260879 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: warnings.warn(msg) May 16 19:00:41.280146 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-2aa9e716-cf42-4ff0-a43e-c6e828b2fc6b admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141129 May 16 19:00:41.280941 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 4/8] 10.222.0.24 () {64 vars in 1282 bytes} [Mon May 16 19:00:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:00:41.293010 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-ad5ff765-83fd-4159-8b61-3295e36f7563 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:41.294605 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 19:00:41.294605 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: warnings.warn(msg) May 16 19:00:41.330227 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-ad5ff765-83fd-4159-8b61-3295e36f7563 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040830 May 16 19:00:41.330755 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 5/9] 10.222.0.24 () {64 vars in 1335 bytes} [Mon May 16 19:00:41 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:00:43.640951 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-2aa9e716-cf42-4ff0-a43e-c6e828b2fc6b admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:43.642027 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-2aa9e716-cf42-4ff0-a43e-c6e828b2fc6b admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 May 16 19:00:43.642426 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 5/10] 10.222.0.24 () {54 vars in 930 bytes} [Mon May 16 19:00:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:00:43.702756 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-23bc0580-809a-43a9-bd7d-2ebeab9ed5e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "name": "ds1G", "id": "d2", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:43.723268 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-23bc0580-809a-43a9-bd7d-2ebeab9ed5e1 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074867 May 16 19:00:43.723820 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 6/11] 10.222.0.24 () {64 vars in 1282 bytes} [Mon May 16 19:00:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:00:43.735601 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-30b8d0f2-f02d-4edb-a4c7-9ffd33d45472 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:43.760139 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-30b8d0f2-f02d-4edb-a4c7-9ffd33d45472 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028167 May 16 19:00:43.761928 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 6/12] 10.222.0.24 () {64 vars in 1335 bytes} [Mon May 16 19:00:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:46.010202 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-23bc0580-809a-43a9-bd7d-2ebeab9ed5e1 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:46.011226 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-23bc0580-809a-43a9-bd7d-2ebeab9ed5e1 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 May 16 19:00:46.011618 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 7/13] 10.222.0.24 () {54 vars in 930 bytes} [Mon May 16 19:00:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:00:46.076797 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-f9948fea-d30b-482c-a9de-51e536c2e1c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3", "ram": 2048, "vcpus": 2, "disk": 10, "swap": 0}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:46.096222 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-f9948fea-d30b-482c-a9de-51e536c2e1c2 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077969 May 16 19:00:46.096779 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 7/14] 10.222.0.24 () {64 vars in 1282 bytes} [Mon May 16 19:00:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:00:46.108585 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-d3a9078f-1697-44cc-93b6-8adfbdc986d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:46.131306 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-d3a9078f-1697-44cc-93b6-8adfbdc986d0 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026429 May 16 19:00:46.131894 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 8/15] 10.222.0.24 () {64 vars in 1335 bytes} [Mon May 16 19:00:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:48.377459 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-f9948fea-d30b-482c-a9de-51e536c2e1c2 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:48.378613 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-f9948fea-d30b-482c-a9de-51e536c2e1c2 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 May 16 19:00:48.379063 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 8/16] 10.222.0.24 () {54 vars in 930 bytes} [Mon May 16 19:00:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:00:48.437746 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-855388a4-5dfd-4c8e-8506-3266a7f36e4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "ram": 4096}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:48.457078 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-855388a4-5dfd-4c8e-8506-3266a7f36e4b admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071959 May 16 19:00:48.464841 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 9/17] 10.222.0.24 () {64 vars in 1282 bytes} [Mon May 16 19:00:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:00:48.472833 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-21b34a5c-f31e-47ec-9bc1-ba68baa0d601 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:48.499298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-21b34a5c-f31e-47ec-9bc1-ba68baa0d601 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033171 May 16 19:00:48.500522 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 9/18] 10.222.0.24 () {64 vars in 1335 bytes} [Mon May 16 19:00:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:50.756900 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-855388a4-5dfd-4c8e-8506-3266a7f36e4b admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:50.758082 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-855388a4-5dfd-4c8e-8506-3266a7f36e4b admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 May 16 19:00:50.758749 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 10/19] 10.222.0.24 () {54 vars in 930 bytes} [Mon May 16 19:00:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:00:50.818610 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-1722d2fa-b1f2-41c6-a7e2-b4a2ff72fa0c admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:50.841860 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-1722d2fa-b1f2-41c6-a7e2-b4a2ff72fa0c admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076801 May 16 19:00:50.842639 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 10/20] 10.222.0.24 () {60 vars in 1291 bytes} [Mon May 16 19:00:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:00:53.117441 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-855388a4-5dfd-4c8e-8506-3266a7f36e4b admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:53.118528 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-855388a4-5dfd-4c8e-8506-3266a7f36e4b admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 May 16 19:00:53.118932 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 11/21] 10.222.0.24 () {54 vars in 930 bytes} [Mon May 16 19:00:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:00:53.188471 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-85bb4cc3-0463-4e2e-80c6-8a3ffee2ad69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "1", "ram": 512, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:53.206787 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-85bb4cc3-0463-4e2e-80c6-8a3ffee2ad69 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081807 May 16 19:00:53.207405 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 11/22] 10.222.0.24 () {64 vars in 1282 bytes} [Mon May 16 19:00:53 2022] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 19:00:53.219632 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-d676e189-5a28-48bb-9c5e-56c6e124cc91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:53.244211 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-d676e189-5a28-48bb-9c5e-56c6e124cc91 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028434 May 16 19:00:53.244830 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 12/23] 10.222.0.24 () {64 vars in 1332 bytes} [Mon May 16 19:00:53 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:55.554355 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-85bb4cc3-0463-4e2e-80c6-8a3ffee2ad69 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:55.555578 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-85bb4cc3-0463-4e2e-80c6-8a3ffee2ad69 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001820 May 16 19:00:55.556011 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 12/24] 10.222.0.24 () {54 vars in 930 bytes} [Mon May 16 19:00:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:00:55.631184 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-815d8254-7383-4a51-84aa-31d3a8583401 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "disk": 20, "rxtx_factor": 1.0}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:55.657275 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-815d8254-7383-4a51-84aa-31d3a8583401 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.092754 May 16 19:00:55.657673 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 13/25] 10.222.0.24 () {64 vars in 1282 bytes} [Mon May 16 19:00:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:00:55.670614 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-d3c59493-3948-4b76-a482-0e978180bd97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:55.697651 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-d3c59493-3948-4b76-a482-0e978180bd97 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031375 May 16 19:00:55.698367 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 13/26] 10.222.0.24 () {64 vars in 1332 bytes} [Mon May 16 19:00:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:00:58.020316 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-815d8254-7383-4a51-84aa-31d3a8583401 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:00:58.021508 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-815d8254-7383-4a51-84aa-31d3a8583401 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001738 May 16 19:00:58.022104 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 14/27] 10.222.0.24 () {54 vars in 930 bytes} [Mon May 16 19:00:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:00:58.083195 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-a87d0c9f-8333-46c3-827d-5a9a10fb4c2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "disk": 40, "rxtx_factor": 1.0, "swap": 0, "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:58.101354 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-a87d0c9f-8333-46c3-827d-5a9a10fb4c2f admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073136 May 16 19:00:58.108861 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 14/28] 10.222.0.24 () {64 vars in 1282 bytes} [Mon May 16 19:00:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:00:58.115595 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-d0d798e4-7f8d-4d0f-95df-aa1bbda3448a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:00:58.142478 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-d0d798e4-7f8d-4d0f-95df-aa1bbda3448a admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031799 May 16 19:00:58.143065 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 15/29] 10.222.0.24 () {64 vars in 1332 bytes} [Mon May 16 19:00:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:01:00.358325 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-a87d0c9f-8333-46c3-827d-5a9a10fb4c2f admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:00.359430 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-a87d0c9f-8333-46c3-827d-5a9a10fb4c2f admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 May 16 19:01:00.360082 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 15/30] 10.222.0.24 () {54 vars in 930 bytes} [Mon May 16 19:01:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:01:00.420115 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-8902457f-f3b8-4529-a92f-a1b477f5e84b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "vcpus": 4}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:01:00.443671 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-8902457f-f3b8-4529-a92f-a1b477f5e84b admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077345 May 16 19:01:00.444233 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 16/31] 10.222.0.24 () {64 vars in 1282 bytes} [Mon May 16 19:01:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:01:00.456058 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-601caf42-9ad1-4dae-b454-19f098c3fe7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:01:00.479065 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-601caf42-9ad1-4dae-b454-19f098c3fe7a admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026730 May 16 19:01:00.479644 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 16/32] 10.222.0.24 () {64 vars in 1332 bytes} [Mon May 16 19:01:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:01:02.791835 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-8902457f-f3b8-4529-a92f-a1b477f5e84b admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:02.792857 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-8902457f-f3b8-4529-a92f-a1b477f5e84b admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 16 19:01:02.793267 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 17/33] 10.222.0.24 () {54 vars in 930 bytes} [Mon May 16 19:01:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:01:02.854294 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-f97351c5-e780-4e99-ba01-f9c05a443fcb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "swap": 0, "vcpus": 8, "name": "m1.xlarge", "ram": 16384, "disk": 160}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:01:02.873025 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-f97351c5-e780-4e99-ba01-f9c05a443fcb admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073394 May 16 19:01:02.886120 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-bc050d63-c7d5-4874-aafc-2ceb5d5ad745 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:01:02.892495 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 17/34] 10.222.0.24 () {64 vars in 1282 bytes} [Mon May 16 19:01:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:01:02.915237 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-bc050d63-c7d5-4874-aafc-2ceb5d5ad745 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033243 May 16 19:01:02.915820 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 18/35] 10.222.0.24 () {64 vars in 1332 bytes} [Mon May 16 19:01:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:01:26.895447 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-f97351c5-e780-4e99-ba01-f9c05a443fcb admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:26.896484 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-f97351c5-e780-4e99-ba01-f9c05a443fcb admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 16 19:01:26.896908 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 18/36] 10.222.0.24 () {54 vars in 930 bytes} [Mon May 16 19:01:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:01:26.956516 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-0210aba7-49c9-45c0-8834-54ddf558dd47 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:26.973286 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-0210aba7-49c9-45c0-8834-54ddf558dd47 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070217 May 16 19:01:26.973915 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 19/37] 10.222.0.24 () {60 vars in 1291 bytes} [Mon May 16 19:01:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:01:28.051009 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-f97351c5-e780-4e99-ba01-f9c05a443fcb admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:28.052143 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-f97351c5-e780-4e99-ba01-f9c05a443fcb admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 16 19:01:28.052566 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 19/38] 10.222.0.24 () {56 vars in 1074 bytes} [Mon May 16 19:01:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:01:28.272114 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-7de4ed56-8e1e-4eab-bbd5-772830862bb7 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:28.278254 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.wsgi [None req-7de4ed56-8e1e-4eab-bbd5-772830862bb7 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-7de4ed56-8e1e-4eab-bbd5-772830862bb7 admin admin] Request method failure captured: May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Accept: application/json May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Accept-Encoding: gzip, deflate May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Connection: keep-alive May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Content-Length: 0 May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Host: 10.222.0.24 May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Openstack-Api-Version: compute 2.90 May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Openstack-System-Scope: None May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: User-Agent: python-novaclient May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Auth-Token: gAAAAABigp-IuRd_GjK_5X889-b1WVE7i1tlsPYPF7eq6E77_J4odnjj8ahhi6M8GgDXIpoyTZeiwR3OepnpktpWcXLX2yMnuSbnpe9LrXlcvfEndUcxKglR1rvmMrwwT_datnj-ISqc3iwoOBfrA-a-s8MJZI_FQkbt8daLKjlE83nfOOHHdSc May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Domain-Id: None May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Domain-Name: None May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Identity-Status: Confirmed May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Is-Admin-Project: True May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Openstack-Nova-Api-Version: 2.90 May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Project-Domain-Id: default May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Project-Domain-Name: Default May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Project-Id: 1f43cb24f4194077b63c058f20af8f90 May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Project-Name: admin May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Role: reader,member,admin May 16 19:01:28.281929 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Roles: reader,member,admin May 16 19:01:28.284193 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:01:28.284193 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Tenant: admin May 16 19:01:28.284193 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Tenant-Id: 1f43cb24f4194077b63c058f20af8f90 May 16 19:01:28.284193 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Tenant-Name: admin May 16 19:01:28.284193 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-User: admin May 16 19:01:28.284193 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-User-Domain-Id: default May 16 19:01:28.284193 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-User-Domain-Name: Default May 16 19:01:28.284193 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-User-Id: e70b26bfebd8410b8d3b2aa16cacd530 May 16 19:01:28.284193 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-User-Name: admin May 16 19:01:28.284193 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: method: > May 16 19:01:28.284193 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: exception: Flavor 42 could not be found. May 16 19:01:28.284193 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: action_args: {'id': '42'} May 16 19:01:28.284193 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:01:28.284193 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:01:28.285805 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi May 16 19:01:28.288314 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-7de4ed56-8e1e-4eab-bbd5-772830862bb7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:01:28.289750 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-7de4ed56-8e1e-4eab-bbd5-772830862bb7 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.079115 May 16 19:01:28.289750 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 20/39] 10.222.0.24 () {60 vars in 1190 bytes} [Mon May 16 19:01:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 19:01:28.298339 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-74a20f7f-33a4-47ba-b8e6-f7e1b5bc780d admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:28.328474 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-74a20f7f-33a4-47ba-b8e6-f7e1b5bc780d admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.037591 May 16 19:01:28.329020 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 20/40] 10.222.0.24 () {60 vars in 1210 bytes} [Mon May 16 19:01:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:01:28.345306 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-c0487eea-5b1d-40d3-b3f7-f509c420c767 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:28.366883 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-c0487eea-5b1d-40d3-b3f7-f509c420c767 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025178 May 16 19:01:28.367435 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 21/41] 10.222.0.24 () {60 vars in 1210 bytes} [Mon May 16 19:01:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:01:28.376988 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-c58c155c-3d0f-44ba-a7c5-8623b3f86a8a admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:28.383007 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.wsgi [None req-c58c155c-3d0f-44ba-a7c5-8623b3f86a8a admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-c58c155c-3d0f-44ba-a7c5-8623b3f86a8a admin admin] Request method failure captured: May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Accept: application/json May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Accept-Encoding: gzip, deflate May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Connection: keep-alive May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Content-Length: 0 May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Host: 10.222.0.24 May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Openstack-Api-Version: compute 2.90 May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Openstack-System-Scope: None May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: User-Agent: python-novaclient May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Auth-Token: gAAAAABigp-IuRd_GjK_5X889-b1WVE7i1tlsPYPF7eq6E77_J4odnjj8ahhi6M8GgDXIpoyTZeiwR3OepnpktpWcXLX2yMnuSbnpe9LrXlcvfEndUcxKglR1rvmMrwwT_datnj-ISqc3iwoOBfrA-a-s8MJZI_FQkbt8daLKjlE83nfOOHHdSc May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Domain-Id: None May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Domain-Name: None May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Identity-Status: Confirmed May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Is-Admin-Project: True May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Openstack-Nova-Api-Version: 2.90 May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Project-Domain-Id: default May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Project-Domain-Name: Default May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Project-Id: 1f43cb24f4194077b63c058f20af8f90 May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Project-Name: admin May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Role: reader,member,admin May 16 19:01:28.386298 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Roles: reader,member,admin May 16 19:01:28.387811 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:01:28.387811 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Tenant: admin May 16 19:01:28.387811 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Tenant-Id: 1f43cb24f4194077b63c058f20af8f90 May 16 19:01:28.387811 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Tenant-Name: admin May 16 19:01:28.387811 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-User: admin May 16 19:01:28.387811 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-User-Domain-Id: default May 16 19:01:28.387811 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-User-Domain-Name: Default May 16 19:01:28.387811 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-User-Id: e70b26bfebd8410b8d3b2aa16cacd530 May 16 19:01:28.387811 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-User-Name: admin May 16 19:01:28.387811 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: method: > May 16 19:01:28.387811 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: exception: Flavor 42 could not be found. May 16 19:01:28.387811 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: action_args: {'id': '42'} May 16 19:01:28.387811 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:01:28.387811 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:01:28.388731 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi May 16 19:01:28.390121 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-c58c155c-3d0f-44ba-a7c5-8623b3f86a8a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:01:28.391395 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-c58c155c-3d0f-44ba-a7c5-8623b3f86a8a admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014297 May 16 19:01:28.391395 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 21/42] 10.222.0.24 () {60 vars in 1190 bytes} [Mon May 16 19:01:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 19:01:29.287266 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-c0487eea-5b1d-40d3-b3f7-f509c420c767 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:29.288270 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-c0487eea-5b1d-40d3-b3f7-f509c420c767 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 16 19:01:29.288662 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 22/43] 10.222.0.24 () {56 vars in 1074 bytes} [Mon May 16 19:01:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:01:29.493729 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-0262e31f-b463-414b-bb38-73e4786fddff admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:29.499497 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.wsgi [None req-0262e31f-b463-414b-bb38-73e4786fddff admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-0262e31f-b463-414b-bb38-73e4786fddff admin admin] Request method failure captured: May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Accept: application/json May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Accept-Encoding: gzip, deflate May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Connection: keep-alive May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Content-Length: 0 May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Host: 10.222.0.24 May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Openstack-Api-Version: compute 2.90 May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Openstack-System-Scope: None May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: User-Agent: python-novaclient May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Auth-Token: gAAAAABigp-JkI9d6ySzupabDMS6qHU7cAWHQxza2-aZQWCnBzeRSO8WMx8hGYU-Gn3en0PF4z9uNiQDLi3tiORPZxYLSSia7Cty8fusQAAaTNfH-ka3d8Q3NVZJPvn_bw0E3lFMaYSku7eTltkLx3j9ZvKPjzN5f0RACZd4JKadYe9GdRnyrmE May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Domain-Id: None May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Domain-Name: None May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Identity-Status: Confirmed May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Is-Admin-Project: True May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Openstack-Nova-Api-Version: 2.90 May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Project-Domain-Id: default May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Project-Domain-Name: Default May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Project-Id: 1f43cb24f4194077b63c058f20af8f90 May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Project-Name: admin May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Role: reader,member,admin May 16 19:01:29.501003 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Roles: reader,member,admin May 16 19:01:29.502522 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:01:29.502522 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Tenant: admin May 16 19:01:29.502522 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Tenant-Id: 1f43cb24f4194077b63c058f20af8f90 May 16 19:01:29.502522 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Tenant-Name: admin May 16 19:01:29.502522 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-User: admin May 16 19:01:29.502522 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-User-Domain-Id: default May 16 19:01:29.502522 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-User-Domain-Name: Default May 16 19:01:29.502522 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-User-Id: e70b26bfebd8410b8d3b2aa16cacd530 May 16 19:01:29.502522 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-User-Name: admin May 16 19:01:29.502522 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: method: > May 16 19:01:29.502522 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: exception: Flavor 84 could not be found. May 16 19:01:29.502522 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: action_args: {'id': '84'} May 16 19:01:29.502522 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:01:29.502522 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:01:29.504607 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi May 16 19:01:29.505962 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-0262e31f-b463-414b-bb38-73e4786fddff admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:01:29.507195 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-0262e31f-b463-414b-bb38-73e4786fddff admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.075438 May 16 19:01:29.507195 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 22/44] 10.222.0.24 () {60 vars in 1190 bytes} [Mon May 16 19:01:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 19:01:29.512517 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-3f00415f-f763-47c0-b2af-9870fc3d85c9 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:29.526820 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-3f00415f-f763-47c0-b2af-9870fc3d85c9 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018066 May 16 19:01:29.527375 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 23/45] 10.222.0.24 () {60 vars in 1210 bytes} [Mon May 16 19:01:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:01:29.537445 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-17fb8429-6ed9-46ba-a242-db4dc9bd4bcc admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:29.551543 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-17fb8429-6ed9-46ba-a242-db4dc9bd4bcc admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017679 May 16 19:01:29.552253 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 23/46] 10.222.0.24 () {60 vars in 1210 bytes} [Mon May 16 19:01:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:01:29.561946 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-e21acef0-cdd7-4871-8e85-ddf64cc0c421 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:29.568039 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.wsgi [None req-e21acef0-cdd7-4871-8e85-ddf64cc0c421 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-e21acef0-cdd7-4871-8e85-ddf64cc0c421 admin admin] Request method failure captured: May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Accept: application/json May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Accept-Encoding: gzip, deflate May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Connection: keep-alive May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Content-Length: 0 May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Host: 10.222.0.24 May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Openstack-Api-Version: compute 2.90 May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Openstack-System-Scope: None May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: User-Agent: python-novaclient May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Auth-Token: gAAAAABigp-JkI9d6ySzupabDMS6qHU7cAWHQxza2-aZQWCnBzeRSO8WMx8hGYU-Gn3en0PF4z9uNiQDLi3tiORPZxYLSSia7Cty8fusQAAaTNfH-ka3d8Q3NVZJPvn_bw0E3lFMaYSku7eTltkLx3j9ZvKPjzN5f0RACZd4JKadYe9GdRnyrmE May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Domain-Id: None May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Domain-Name: None May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Identity-Status: Confirmed May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Is-Admin-Project: True May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Openstack-Nova-Api-Version: 2.90 May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Project-Domain-Id: default May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Project-Domain-Name: Default May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Project-Id: 1f43cb24f4194077b63c058f20af8f90 May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Project-Name: admin May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Role: reader,member,admin May 16 19:01:29.569571 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Roles: reader,member,admin May 16 19:01:29.570949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:01:29.570949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Tenant: admin May 16 19:01:29.570949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Tenant-Id: 1f43cb24f4194077b63c058f20af8f90 May 16 19:01:29.570949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Tenant-Name: admin May 16 19:01:29.570949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-User: admin May 16 19:01:29.570949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-User-Domain-Id: default May 16 19:01:29.570949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-User-Domain-Name: Default May 16 19:01:29.570949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-User-Id: e70b26bfebd8410b8d3b2aa16cacd530 May 16 19:01:29.570949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-User-Name: admin May 16 19:01:29.570949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: method: > May 16 19:01:29.570949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: exception: Flavor 84 could not be found. May 16 19:01:29.570949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: action_args: {'id': '84'} May 16 19:01:29.570949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:01:29.570949 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:01:29.571779 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi May 16 19:01:29.572944 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-e21acef0-cdd7-4871-8e85-ddf64cc0c421 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:01:29.574292 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-e21acef0-cdd7-4871-8e85-ddf64cc0c421 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012557 May 16 19:01:29.574292 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 24/47] 10.222.0.24 () {60 vars in 1190 bytes} [Mon May 16 19:01:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 19:01:30.473077 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-17fb8429-6ed9-46ba-a242-db4dc9bd4bcc admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:30.474234 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-17fb8429-6ed9-46ba-a242-db4dc9bd4bcc admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 May 16 19:01:30.474635 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 24/48] 10.222.0.24 () {56 vars in 1074 bytes} [Mon May 16 19:01:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:01:30.665996 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-6452c728-36e8-4b59-98d0-fa566f021559 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:30.671829 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.wsgi [None req-6452c728-36e8-4b59-98d0-fa566f021559 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-6452c728-36e8-4b59-98d0-fa566f021559 admin admin] Request method failure captured: May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Accept: application/json May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Accept-Encoding: gzip, deflate May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Connection: keep-alive May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Content-Length: 0 May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Host: 10.222.0.24 May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Openstack-Api-Version: compute 2.90 May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Openstack-System-Scope: None May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: User-Agent: python-novaclient May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Auth-Token: gAAAAABigp-K8ne5Vwdy5j3nk-O8lIOfx6_1e0FSTm-lHQyTAx7_WXHkxTGHTHtebMBnc6VQRAdr0L073Q_vh6kUPpPgVYMlj72Xm5HggWDhfs5z8jZ4Cs5gGiqaWMF08cFDHxcBwpNzpo0RyOk867KTqIEbYXlS73W-wNP2lT3gWkO6i94ojrI May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Domain-Id: None May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Domain-Name: None May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Identity-Status: Confirmed May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Is-Admin-Project: True May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Openstack-Nova-Api-Version: 2.90 May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Project-Domain-Id: default May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Project-Domain-Name: Default May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Project-Id: 1f43cb24f4194077b63c058f20af8f90 May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Project-Name: admin May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Role: reader,member,admin May 16 19:01:30.673381 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Roles: reader,member,admin May 16 19:01:30.674825 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:01:30.674825 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Tenant: admin May 16 19:01:30.674825 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Tenant-Id: 1f43cb24f4194077b63c058f20af8f90 May 16 19:01:30.674825 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-Tenant-Name: admin May 16 19:01:30.674825 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-User: admin May 16 19:01:30.674825 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-User-Domain-Id: default May 16 19:01:30.674825 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-User-Domain-Name: Default May 16 19:01:30.674825 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-User-Id: e70b26bfebd8410b8d3b2aa16cacd530 May 16 19:01:30.674825 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: X-User-Name: admin May 16 19:01:30.674825 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: method: > May 16 19:01:30.674825 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: exception: Flavor 451 could not be found. May 16 19:01:30.674825 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: action_args: {'id': '451'} May 16 19:01:30.674825 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:01:30.674825 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:01:30.675861 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: ERROR nova.api.openstack.wsgi May 16 19:01:30.677199 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-6452c728-36e8-4b59-98d0-fa566f021559 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:01:30.678474 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-6452c728-36e8-4b59-98d0-fa566f021559 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.065975 May 16 19:01:30.678474 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 25/49] 10.222.0.24 () {60 vars in 1193 bytes} [Mon May 16 19:01:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 19:01:30.684554 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-ebe7db7e-b78b-4fbc-99ac-39a9e57a22e4 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:30.698376 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-ebe7db7e-b78b-4fbc-99ac-39a9e57a22e4 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017402 May 16 19:01:30.698921 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 25/50] 10.222.0.24 () {60 vars in 1210 bytes} [Mon May 16 19:01:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:01:30.708423 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-5a69829d-37a5-4034-9b41-65f66274c0f8 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:30.722010 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-5a69829d-37a5-4034-9b41-65f66274c0f8 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017046 May 16 19:01:30.722532 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 26/51] 10.222.0.24 () {60 vars in 1210 bytes} [Mon May 16 19:01:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:01:30.731851 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-9ebde21d-e0fe-4a0d-ac6b-4085ee2d3f47 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:30.737707 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.wsgi [None req-9ebde21d-e0fe-4a0d-ac6b-4085ee2d3f47 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-9ebde21d-e0fe-4a0d-ac6b-4085ee2d3f47 admin admin] Request method failure captured: May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Accept: application/json May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Accept-Encoding: gzip, deflate May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Connection: keep-alive May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Content-Length: 0 May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Host: 10.222.0.24 May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Openstack-Api-Version: compute 2.90 May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Openstack-System-Scope: None May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: User-Agent: python-novaclient May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Auth-Token: gAAAAABigp-K8ne5Vwdy5j3nk-O8lIOfx6_1e0FSTm-lHQyTAx7_WXHkxTGHTHtebMBnc6VQRAdr0L073Q_vh6kUPpPgVYMlj72Xm5HggWDhfs5z8jZ4Cs5gGiqaWMF08cFDHxcBwpNzpo0RyOk867KTqIEbYXlS73W-wNP2lT3gWkO6i94ojrI May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Domain-Id: None May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Domain-Name: None May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Identity-Status: Confirmed May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Is-Admin-Project: True May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Openstack-Nova-Api-Version: 2.90 May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Project-Domain-Id: default May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Project-Domain-Name: Default May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Project-Id: 1f43cb24f4194077b63c058f20af8f90 May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Project-Name: admin May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Role: reader,member,admin May 16 19:01:30.739193 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Roles: reader,member,admin May 16 19:01:30.740563 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1f43cb24f4194077b63c058f20af8f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:01:30.740563 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Tenant: admin May 16 19:01:30.740563 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Tenant-Id: 1f43cb24f4194077b63c058f20af8f90 May 16 19:01:30.740563 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-Tenant-Name: admin May 16 19:01:30.740563 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-User: admin May 16 19:01:30.740563 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-User-Domain-Id: default May 16 19:01:30.740563 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-User-Domain-Name: Default May 16 19:01:30.740563 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-User-Id: e70b26bfebd8410b8d3b2aa16cacd530 May 16 19:01:30.740563 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: X-User-Name: admin May 16 19:01:30.740563 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: method: > May 16 19:01:30.740563 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: exception: Flavor 451 could not be found. May 16 19:01:30.740563 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: action_args: {'id': '451'} May 16 19:01:30.740563 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:01:30.740563 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:01:30.741416 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: ERROR nova.api.openstack.wsgi May 16 19:01:30.742525 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-9ebde21d-e0fe-4a0d-ac6b-4085ee2d3f47 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:01:30.743971 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-9ebde21d-e0fe-4a0d-ac6b-4085ee2d3f47 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012184 May 16 19:01:30.743971 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 26/52] 10.222.0.24 () {60 vars in 1193 bytes} [Mon May 16 19:01:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 19:01:31.635069 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-5a69829d-37a5-4034-9b41-65f66274c0f8 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:31.636086 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-5a69829d-37a5-4034-9b41-65f66274c0f8 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 16 19:01:31.636484 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 27/53] 10.222.0.24 () {56 vars in 1074 bytes} [Mon May 16 19:01:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:01:31.830123 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-eb14516f-f0ec-4f31-ab15-aa279f7472b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:01:31.850272 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-eb14516f-f0ec-4f31-ab15-aa279f7472b0 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072820 May 16 19:01:31.850708 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 27/54] 10.222.0.24 () {64 vars in 1235 bytes} [Mon May 16 19:01:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:01:32.732172 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-5a69829d-37a5-4034-9b41-65f66274c0f8 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:32.733508 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-5a69829d-37a5-4034-9b41-65f66274c0f8 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 May 16 19:01:32.734046 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 28/55] 10.222.0.24 () {56 vars in 1074 bytes} [Mon May 16 19:01:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:01:32.925342 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-a755e49a-2ce8-454d-9b27-e80b0b624551 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:01:32.944366 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-a755e49a-2ce8-454d-9b27-e80b0b624551 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.074342 May 16 19:01:32.944818 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 28/56] 10.222.0.24 () {64 vars in 1235 bytes} [Mon May 16 19:01:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:01:33.835231 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-5a69829d-37a5-4034-9b41-65f66274c0f8 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:33.836550 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-5a69829d-37a5-4034-9b41-65f66274c0f8 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002031 May 16 19:01:33.837082 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 29/57] 10.222.0.24 () {56 vars in 1074 bytes} [Mon May 16 19:01:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:01:34.028761 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-8318d22d-ae36-4ce2-b446-fef879534548 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:01:34.048733 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-8318d22d-ae36-4ce2-b446-fef879534548 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.077222 May 16 19:01:34.049272 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 29/58] 10.222.0.24 () {64 vars in 1235 bytes} [Mon May 16 19:01:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 19:01:34.921562 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-5a69829d-37a5-4034-9b41-65f66274c0f8 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:34.922597 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-5a69829d-37a5-4034-9b41-65f66274c0f8 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 16 19:01:34.922965 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 30/59] 10.222.0.24 () {56 vars in 1074 bytes} [Mon May 16 19:01:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:01:35.121701 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-c8034f04-d1cc-4816-9f89-90eac46c94f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:01:35.144670 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-c8034f04-d1cc-4816-9f89-90eac46c94f1 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.087437 May 16 19:01:35.145126 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 30/60] 10.222.0.24 () {64 vars in 1235 bytes} [Mon May 16 19:01:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:01:36.028535 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-5a69829d-37a5-4034-9b41-65f66274c0f8 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:36.030098 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-5a69829d-37a5-4034-9b41-65f66274c0f8 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001901 May 16 19:01:36.030590 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 31/61] 10.222.0.24 () {56 vars in 1074 bytes} [Mon May 16 19:01:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:01:36.228914 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-06285f2c-df7c-40d3-8ca9-c7df904e0d44 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:01:36.248347 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-06285f2c-df7c-40d3-8ca9-c7df904e0d44 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076575 May 16 19:01:36.249011 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 31/62] 10.222.0.24 () {60 vars in 1202 bytes} [Mon May 16 19:01:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:02:37.795928 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-5a69829d-37a5-4034-9b41-65f66274c0f8 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:02:37.796930 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-5a69829d-37a5-4034-9b41-65f66274c0f8 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 16 19:02:37.797356 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 32/63] 10.222.0.24 () {54 vars in 930 bytes} [Mon May 16 19:02:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:02:37.869117 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-dfbd85b3-e0e7-44f3-90a1-af96091a0b74 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:02:37.888452 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-dfbd85b3-e0e7-44f3-90a1-af96091a0b74 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.084440 May 16 19:02:37.889073 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 32/64] 10.222.0.24 () {60 vars in 1291 bytes} [Mon May 16 19:02:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:02:37.913888 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-23eeb5fb-d70c-4c6b-9245-daa3295cd033 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:02:37.921983 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-23eeb5fb-d70c-4c6b-9245-daa3295cd033 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014046 May 16 19:02:37.922509 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 33/65] 10.222.0.24 () {60 vars in 1282 bytes} [Mon May 16 19:02:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:02:37.933714 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-adbd127f-c126-43be-bd23-955697743a79 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:02:37.941743 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-adbd127f-c126-43be-bd23-955697743a79 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011515 May 16 19:02:37.942317 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 33/66] 10.222.0.24 () {60 vars in 1285 bytes} [Mon May 16 19:02:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:02:37.953319 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-309632f5-4f27-42e6-b63c-88c939ed3963 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:02:37.961070 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-309632f5-4f27-42e6-b63c-88c939ed3963 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011228 May 16 19:02:37.961628 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 34/67] 10.222.0.24 () {60 vars in 1285 bytes} [Mon May 16 19:02:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:02:37.972685 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-ecc5ddcf-286f-4bbb-921a-535ce6f3e511 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:02:37.980556 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-ecc5ddcf-286f-4bbb-921a-535ce6f3e511 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011368 May 16 19:02:37.981096 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 34/68] 10.222.0.24 () {60 vars in 1282 bytes} [Mon May 16 19:02:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:05:58.585557 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-309632f5-4f27-42e6-b63c-88c939ed3963 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:05:58.586567 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-309632f5-4f27-42e6-b63c-88c939ed3963 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 May 16 19:05:58.586971 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 35/69] 10.222.0.24 () {56 vars in 1074 bytes} [Mon May 16 19:05:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:05:58.867310 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-390dd4a9-8be6-4e25-929d-916376e30436 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:05:58.868796 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 19:05:58.868796 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: warnings.warn(msg) May 16 19:05:58.870030 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-390dd4a9-8be6-4e25-929d-916376e30436 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:05:58.870467 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-390dd4a9-8be6-4e25-929d-916376e30436 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:05:58.871253 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-390dd4a9-8be6-4e25-929d-916376e30436 admin admin] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:05:58.871674 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-390dd4a9-8be6-4e25-929d-916376e30436 admin admin] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:05:58.904985 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-390dd4a9-8be6-4e25-929d-916376e30436 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.165092 May 16 19:05:58.905564 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 35/70] 10.222.0.24 () {60 vars in 1193 bytes} [Mon May 16 19:05:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:05:59.825614 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-309632f5-4f27-42e6-b63c-88c939ed3963 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:05:59.826654 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-309632f5-4f27-42e6-b63c-88c939ed3963 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 16 19:05:59.827056 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 36/71] 10.222.0.24 () {56 vars in 1074 bytes} [Mon May 16 19:05:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:06:00.017970 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-34af7887-6f6d-49e2-8086-8492a73bd2ae admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:06:00.019175 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 19:06:00.019175 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: warnings.warn(msg) May 16 19:06:00.020384 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-34af7887-6f6d-49e2-8086-8492a73bd2ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:06:00.020859 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-34af7887-6f6d-49e2-8086-8492a73bd2ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:06:00.021668 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-34af7887-6f6d-49e2-8086-8492a73bd2ae admin admin] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:06:00.022093 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-34af7887-6f6d-49e2-8086-8492a73bd2ae admin admin] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:06:00.041267 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-34af7887-6f6d-49e2-8086-8492a73bd2ae admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076345 May 16 19:06:00.041771 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 36/72] 10.222.0.24 () {60 vars in 1193 bytes} [Mon May 16 19:05:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:06:11.402556 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-309632f5-4f27-42e6-b63c-88c939ed3963 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:06:11.403565 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-309632f5-4f27-42e6-b63c-88c939ed3963 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 16 19:06:11.403967 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 37/73] 10.222.0.24 () {56 vars in 1074 bytes} [Mon May 16 19:06:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:06:11.599187 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-d105066e-fbd3-4ee1-9cdb-e3c666395b6d admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:06:11.600351 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 19:06:11.600351 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: warnings.warn(msg) May 16 19:06:11.601571 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-d105066e-fbd3-4ee1-9cdb-e3c666395b6d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:06:11.602076 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-d105066e-fbd3-4ee1-9cdb-e3c666395b6d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:06:11.602877 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-d105066e-fbd3-4ee1-9cdb-e3c666395b6d admin admin] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:06:11.603293 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-d105066e-fbd3-4ee1-9cdb-e3c666395b6d admin admin] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:06:11.627345 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-d105066e-fbd3-4ee1-9cdb-e3c666395b6d admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085580 May 16 19:06:11.627926 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 37/74] 10.222.0.24 () {60 vars in 1193 bytes} [Mon May 16 19:06:11 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:06:12.529564 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-309632f5-4f27-42e6-b63c-88c939ed3963 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:06:12.530646 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-309632f5-4f27-42e6-b63c-88c939ed3963 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 16 19:06:12.531039 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 38/75] 10.222.0.24 () {56 vars in 1074 bytes} [Mon May 16 19:06:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:06:12.726117 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-3f52ece1-1ad5-4b1f-80c2-ac2ea5fe9c57 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:06:12.727355 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 19:06:12.727355 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: warnings.warn(msg) May 16 19:06:12.728488 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-3f52ece1-1ad5-4b1f-80c2-ac2ea5fe9c57 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:06:12.728926 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-3f52ece1-1ad5-4b1f-80c2-ac2ea5fe9c57 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:06:12.729765 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-3f52ece1-1ad5-4b1f-80c2-ac2ea5fe9c57 admin admin] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:06:12.730194 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-3f52ece1-1ad5-4b1f-80c2-ac2ea5fe9c57 admin admin] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:06:12.752235 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-3f52ece1-1ad5-4b1f-80c2-ac2ea5fe9c57 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084247 May 16 19:06:12.752785 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 38/76] 10.222.0.24 () {60 vars in 1193 bytes} [Mon May 16 19:06:12 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:07:12.123135 dv-cinder-766064-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 16 19:07:12.124071 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: Mon May 16 19:07:12 2022 - graceful shutdown triggered... May 16 19:07:12.124536 dv-cinder-766064-6-iscsi devstack@n-api.service[102934]: Gracefully killing worker 2 (pid: 102934)... May 16 19:07:12.124896 dv-cinder-766064-6-iscsi devstack@n-api.service[102933]: Gracefully killing worker 1 (pid: 102933)... May 16 19:07:13.124411 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: worker 1 buried after 1 seconds May 16 19:07:13.124411 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: worker 2 buried after 1 seconds May 16 19:07:13.124411 dv-cinder-766064-6-iscsi devstack@n-api.service[102932]: goodbye to uWSGI. May 16 19:07:13.126061 dv-cinder-766064-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 16 19:07:13.126668 dv-cinder-766064-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 16 19:07:13.129349 dv-cinder-766064-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 19:07:13.146095 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 19:07:13.170189 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 19:07:13 2022] *** May 16 19:07:13.170189 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 19:07:13.170189 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 19:07:13.170189 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: nodename: dv-cinder-766064-6-iscsi May 16 19:07:13.170189 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: machine: x86_64 May 16 19:07:13.170189 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: clock source: unix May 16 19:07:13.170189 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: pcre jit disabled May 16 19:07:13.170189 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: detected number of CPU cores: 4 May 16 19:07:13.170189 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: current working directory: / May 16 19:07:13.170189 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: detected binary path: /usr/bin/uwsgi-core May 16 19:07:13.170189 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: your processes number limit is 47680 May 16 19:07:13.170189 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: your memory page size is 4096 bytes May 16 19:07:13.170189 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: detected max file descriptor number: 2048 May 16 19:07:13.170189 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: lock engine: pthread robust mutexes May 16 19:07:13.171290 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: thunder lock: enabled May 16 19:07:13.171290 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 19:07:13.171290 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 19:07:13.219240 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: Python main interpreter initialized at 0x55bc46de79c0 May 16 19:07:13.219240 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: python threads support enabled May 16 19:07:13.219240 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: your server socket listen backlog is limited to 100 connections May 16 19:07:13.219240 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: your mercy for graceful operations on workers is 90 seconds May 16 19:07:13.219676 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: mapped 403077 bytes (393 KB) for 2 cores May 16 19:07:13.219676 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: *** Operational MODE: preforking *** May 16 19:07:13.219948 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: *** uWSGI is running in multiple interpreter mode *** May 16 19:07:13.219948 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: spawned uWSGI master process (pid: 117257) May 16 19:07:13.220164 dv-cinder-766064-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 19:07:13.220887 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: spawned uWSGI worker 1 (pid: 117274, cores: 1) May 16 19:07:13.221571 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: spawned uWSGI worker 2 (pid: 117275, cores: 1) May 16 19:07:13.221571 dv-cinder-766064-6-iscsi devstack@n-api.service[117257]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 19:07:14.403278 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 19:07:14.432766 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 19:07:15.191753 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 19:07:15.191753 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: from cryptography.utils import int_from_bytes May 16 19:07:15.192077 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 19:07:15.192077 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: from cryptography.utils import int_from_bytes May 16 19:07:15.218531 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 19:07:15.218531 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: from cryptography.utils import int_from_bytes May 16 19:07:15.218826 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 19:07:15.218826 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: from cryptography.utils import int_from_bytes May 16 19:07:17.581075 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 19:07:17.581672 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 19:07:17.581965 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 19:07:17.582245 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 19:07:17.582493 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 19:07:17.582909 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.583206 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.583544 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.583851 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.584187 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.584527 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.584849 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.585139 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.585501 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.585755 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.586103 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.586430 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-766064-6-iscsi {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.586755 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.587064 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.587378 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.587695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.587965 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.588316 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.588625 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.589116 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.590595 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.590595 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.590595 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.590887 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.591110 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.591413 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.591737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.592054 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.592398 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.592708 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.593114 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-766064-6-iscsi {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.593451 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.593793 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.594086 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.594526 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.594834 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.595127 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.595445 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.595770 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.596093 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.596423 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.596740 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.597054 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.597373 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.597688 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.598013 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.598312 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.598667 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.598950 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.599255 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.599502 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.599809 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.600133 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.600455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.600775 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.601028 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.601311 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.601611 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.601940 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.602254 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.602560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.602865 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.603171 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.603466 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.603764 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.604069 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.604385 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.604696 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.605017 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.605332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.605693 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.605994 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.606392 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.606644 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.606956 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.607297 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.607614 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.608023 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.608307 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.608631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.608938 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.609244 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.609570 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.609894 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.610232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.610526 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.610776 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.611090 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.611398 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.611718 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.612025 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.612332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.612643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.612943 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.613250 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.613595 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.613890 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.614042 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 19:07:17.614539 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.614690 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 19:07:17.614850 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.615006 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 19:07:17.615183 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.615183 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.615458 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 19:07:17.615458 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 19:07:17.615762 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.615762 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.616070 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.616220 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.616752 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.616909 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.617061 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.617210 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.617351 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.617506 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.617687 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.617838 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.618082 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.618228 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.618372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.618526 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.618767 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.618920 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.619060 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.619210 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.619358 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.619515 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.619672 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.619818 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.619966 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-766064-6-iscsi {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.620106 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.620254 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.620395 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.620534 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.620679 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.620826 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.620965 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.621117 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.621264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.621423 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.621602 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.621763 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.621905 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.622053 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.622206 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.622206 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.622483 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.622651 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.622901 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.623052 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.623192 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.623347 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.623494 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.623719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.623882 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.624034 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.624183 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.624333 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.624479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.624618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.624770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.624910 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.625056 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.625213 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.625360 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.625619 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.625773 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.625921 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.626069 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-766064-6-iscsi {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.626210 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.626357 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.626895 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.627045 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.627185 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.627333 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.627472 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.627472 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.627770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.627918 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.628076 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.628292 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.628436 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.628587 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.628754 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.628754 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.629106 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.629254 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.629413 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.629413 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.629741 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.629888 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.630041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.630188 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.630343 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.630483 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.630622 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.630768 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.630915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.631060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.631208 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.631357 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.631506 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.631651 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.631791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.631791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.634673 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.634867 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.635020 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.635172 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.635321 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.635479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.635621 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.635771 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.635918 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.636071 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.636211 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.636367 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.636525 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.637061 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.637219 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.637374 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.637559 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.637709 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.637849 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.637999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.638157 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.638322 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.638596 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.638596 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.638870 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.639122 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.639364 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.639513 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.639665 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.639812 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.639960 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.640107 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.640254 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.640451 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.640593 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.640740 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.640880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.641019 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.641166 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.641316 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.641456 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.641655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.641810 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.641988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.641988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.641988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.642418 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.642559 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.642704 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.642844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.642991 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.643144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.643291 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.643430 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.643568 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.643705 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.643859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.644007 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.644163 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.644311 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.644450 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.644596 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.644924 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.645081 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.645226 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.645373 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.645512 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.645693 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.645848 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.645990 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.646269 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.646439 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.646588 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.646759 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.647334 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.647497 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.647645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.647784 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.647932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.648076 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.648226 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.648373 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.648530 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.648742 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.648904 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.649054 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.649282 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.649435 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.649646 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.649798 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.649944 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.650094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.650234 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.650372 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.650372 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.650644 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.650783 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.650942 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.651088 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.651229 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.651366 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.651366 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.651636 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.651786 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.651979 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.652131 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.652277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.652427 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.652567 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.652714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.652876 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.653017 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.653155 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.653295 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.653441 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.653596 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.653751 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.653900 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.654048 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.654188 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.654328 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.654476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.654625 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.654832 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.655201 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.655358 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.655516 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.655664 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.656167 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.656308 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.656458 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.656599 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.656748 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.656895 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.657440 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.657440 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.657820 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.657820 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.658085 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.658231 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.658372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.658512 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.658661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.658883 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.659027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.659175 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.659404 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.659565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.659728 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.659868 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.660007 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.660147 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.660293 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.660442 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.660588 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.660730 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.660868 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.661006 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.661145 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.661294 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.661434 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.661627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.661627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.662012 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.662162 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.662320 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.662468 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.662615 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.662764 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.662903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.663052 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.663199 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.663339 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.663494 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.663642 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.663790 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.663939 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.664085 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.664225 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.664412 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.664557 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.664696 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 19:07:17.664849 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.664991 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.665288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.665442 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.665638 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.665990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.666145 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.666292 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.666467 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.666467 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.666749 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.666934 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.667104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.667912 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.668007 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.668144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.668259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.668460 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.668604 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.668754 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.668754 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.669110 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.669263 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.669435 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.669728 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.669728 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.669728 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.669728 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.669728 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.669728 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.669728 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.670783 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.670930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.670930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.671203 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.671351 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.671490 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.671628 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.671628 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.671890 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.671890 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.672164 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.672313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.672465 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.672608 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.672608 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.672892 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.673031 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.673177 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.673318 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.673466 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.673627 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.673785 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.673932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.674071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.674262 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.674404 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.674562 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.674703 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.674841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.674988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.675137 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.675448 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.675606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.675747 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.675910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.676132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.676286 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.676452 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.676608 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.676918 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.677070 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.677217 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.677356 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.677495 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.677495 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.678289 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.678472 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.678624 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.678809 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.678986 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.679147 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.679412 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.679559 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.679727 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.679995 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.680158 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.680299 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.680439 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.680588 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.680729 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.680868 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.680868 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.680868 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.681296 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.681446 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.681632 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.681794 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.682029 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.682252 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.682417 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.682569 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.682717 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.682865 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.683019 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.683159 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.683319 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.683459 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.683459 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.683739 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.683880 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.683880 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.683880 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.683880 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.683880 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.683880 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.683880 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.684788 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.684928 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.684928 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.684928 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.685361 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.685670 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.685818 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.685982 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.685982 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.686263 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.686486 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.686627 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.686767 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.686906 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.687045 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.687204 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.687204 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.687204 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.687204 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.687204 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.688160 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.688160 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.688548 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.688700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.688841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.688982 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.688982 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.689270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.689499 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.689717 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.689875 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.690097 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.690242 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.690397 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.690545 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.690685 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.690824 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.690963 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.690963 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.691240 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.691391 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.691537 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.691686 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.691833 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.691987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.692128 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.692267 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.692411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.692563 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.692711 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.692861 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.692861 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.693134 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.693283 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.693424 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.693579 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.693740 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.694030 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.694190 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.694345 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.694536 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.694679 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.694826 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.694976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.695116 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.695276 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.695425 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.695583 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.695861 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.695861 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.696132 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.696283 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.696432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.696580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.696719 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.696858 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.697007 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.697146 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.697304 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.697444 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.697611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.697763 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.698113 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.698369 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.698514 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.698764 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.698918 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.699068 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.699254 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.699407 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.699633 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.699796 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.699945 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.700687 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.700854 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.701007 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.701164 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.701315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.701456 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.701670 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.701845 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.701994 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.702136 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.702281 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.702480 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.702681 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.702833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.702833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.703102 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.703243 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.703382 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.703382 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.703671 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.703811 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.703958 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.703958 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.704231 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.704417 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.704561 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.704725 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.704976 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.705142 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.705295 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.705295 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.705590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.705745 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.706077 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.706231 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.706389 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.706556 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.706696 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.706844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.706983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.707130 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.707290 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.707432 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.707577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.707716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.707855 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.708011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.708367 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.708595 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.708768 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.708994 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.709146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.709296 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.709445 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.709614 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.709832 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.710113 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.710273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.710425 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.710573 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.710730 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.710943 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.711107 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.711248 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.711397 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.711547 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.711687 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.711827 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.711965 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.712124 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.712274 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.712427 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.712577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.712716 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.712855 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.713019 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.713160 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.713306 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.713451 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.713610 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.713765 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.713920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.714068 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.714218 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.714358 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.714504 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.714644 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.714807 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.714947 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.715086 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.715225 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.715364 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.715502 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.715720 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.715862 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.716164 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.716310 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.716457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.716604 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.716755 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.716906 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.717068 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.717320 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.717471 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.717670 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.717813 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.717953 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.718092 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.718437 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.718602 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.718840 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.719005 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.719229 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.719386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.719527 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.719678 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.719845 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.720049 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.720194 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.720945 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.721160 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.721314 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.721465 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.721629 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.721799 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.721941 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.722123 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.722267 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.722407 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.722564 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.722717 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.722868 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.723009 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.723156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.723312 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.723464 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.723606 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.723756 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.723905 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.724046 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.724185 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.724333 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.724482 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.724624 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.724763 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.724902 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.725041 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.725191 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.725339 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.725487 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.725675 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.725826 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.725826 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.726302 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.726302 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.726596 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.726746 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.726886 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.726886 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.727166 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.727166 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.727439 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.727580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.727738 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.727897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.728038 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.728178 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.728555 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.728707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.728873 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.728873 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.729271 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.729506 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.729728 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.729871 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.730039 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.730267 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.730413 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.730554 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.730694 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.730833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.730983 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.731150 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.731362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.731506 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.731654 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.731802 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.731959 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.732116 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.732256 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.732404 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.732553 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.732694 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.732895 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.733043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.733182 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.733564 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.733731 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.733882 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.734034 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.734034 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.734533 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.734840 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.734993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.735155 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.735305 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.735447 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.735594 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.735734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.735874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.736075 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.736233 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.736559 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.736731 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.736889 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.737043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.737201 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.737348 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.737495 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.737736 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.737894 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.738049 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.738197 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.738351 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.738515 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.738883 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.739043 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.739300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.739462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.739713 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.739713 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.740012 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.740160 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.740390 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.740551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.740699 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.740845 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.741037 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.741193 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.741372 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.741611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.741774 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.741929 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.742091 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.742246 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.742400 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.742572 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.742719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.742882 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.743035 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.743181 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.743327 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.743486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.743639 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.743805 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.743959 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.744105 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.744259 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.744406 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.744554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.744708 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.744861 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.745016 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.745163 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.745327 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.745484 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.745686 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.745835 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.745981 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.746134 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.746288 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.746443 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.746769 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.746922 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.747070 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.747216 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.747371 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.747537 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.747689 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.747689 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.747975 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.748119 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.748274 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.748594 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.748956 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.749134 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.749508 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.749683 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.749952 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.750114 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.750275 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.750506 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.750667 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.750823 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.750979 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.751133 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.751287 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.751434 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.751604 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.751816 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.751979 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.752127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.752280 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.752439 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.752602 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.752750 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.752910 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.753065 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.753212 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.753365 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.753512 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.753743 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.753928 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.754093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.754249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.754408 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.754555 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.754710 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.754710 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.755008 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.755008 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.755341 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.756138 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.756314 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.756314 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.756598 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.756910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.757074 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.757235 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.757459 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.757642 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.757799 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.757954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.758107 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.758270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.758424 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.758570 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.758716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.759039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.759200 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.759361 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.759689 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.759852 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.760097 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.760268 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.760417 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.760593 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.760742 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.760896 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.761050 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.761206 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.761363 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.761524 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.761725 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.761982 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.762135 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.762282 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.762443 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.762649 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.762902 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.763057 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.763204 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.763350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.763517 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.763666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.763819 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.763983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.764163 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.764323 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.764480 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.764637 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.764791 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.764937 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.765083 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.765239 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.765401 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.765575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.765728 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.765875 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.766032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.766190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.766337 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.766486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.766640 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.766970 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.767132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.767290 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.767438 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.767594 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.767742 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.767742 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.768028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.768199 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.768346 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.768527 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.768685 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.768842 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.768989 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.769281 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.769430 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.769609 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.769924 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.770191 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.770365 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.770514 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.770671 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.770818 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.770963 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.771109 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.771268 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.771414 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.771560 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.771716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.771873 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.772108 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.772261 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.772408 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.772580 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.772736 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.772898 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.773045 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.773190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.773336 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.773481 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.773649 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.773811 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.773960 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.774106 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.774251 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.774397 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.774554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.774709 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.774858 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.775004 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.775156 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.775310 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.775310 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.775602 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.775757 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.775904 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.776050 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.776196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.776450 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.776623 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.776771 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.777245 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.777459 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.777671 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.777814 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.777920 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.778011 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.778107 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.778195 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.778289 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.778392 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.778486 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.778572 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.778665 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.778760 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.778853 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.778947 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.779040 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.779133 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.779133 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.779282 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.779422 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.779507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.779587 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.779669 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.779788 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.779874 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.779874 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.780017 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.780099 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.780172 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.780252 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.780324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.780403 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.780482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.780561 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.780633 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.781096 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.781189 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.781272 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.781352 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.781425 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.781498 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.781498 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.781940 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.781940 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.782080 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.782160 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.782232 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.782441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.782541 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.782624 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.782706 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.782779 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.782850 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.782920 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.783005 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.783086 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.783172 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.783253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.783333 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.783416 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.783491 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.783569 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.783642 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.783712 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.783793 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.783879 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.783954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.784024 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.784103 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.784177 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.784247 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.784326 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.784400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.784472 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.784542 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.784612 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.784612 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.784612 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.784805 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.784876 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.784876 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.785012 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.785098 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.785178 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.785252 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.785330 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.785409 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.785481 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.785604 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.785684 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.785763 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.785843 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.785843 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.785988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.786061 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.786133 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.786205 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.786275 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.786354 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.786441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.786515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.786611 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.786685 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.786757 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.786828 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.786909 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.786988 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.787060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.787143 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.787224 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.787297 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.787379 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.787460 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.787534 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.787610 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.787685 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.787685 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.787826 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.788002 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.788103 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.788406 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.788502 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.788590 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.788671 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.789002 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.789107 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.789196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.789288 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.789548 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.789732 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.789845 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.790114 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.790256 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.790434 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.790601 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.790737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.790842 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.791080 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.791219 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.791384 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.791479 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.791695 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.791839 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.792021 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.792162 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.792276 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.792373 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.792616 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.792802 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.792900 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.792985 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.793228 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.793369 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.793518 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.793666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.793874 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.794014 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.794168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.794281 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.794501 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.794652 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.794786 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.794902 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.795141 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.795294 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.795453 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.795556 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.795790 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.795950 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.796081 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.796181 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.796405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.796543 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.796701 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.796820 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.797017 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.797114 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.797325 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.797421 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.797664 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.797779 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.797975 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.798095 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.798277 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.798421 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.798590 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.798713 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.798903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.799014 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.799211 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.799306 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.799519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.799615 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.799834 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.799937 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.800140 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.800235 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.800450 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.800546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.800763 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.800908 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.801077 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.801183 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.801404 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.801510 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.801731 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.801839 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.802048 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.802159 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.802357 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.802464 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.802664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.802760 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.802968 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.803074 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.803281 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.803375 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.803591 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.803686 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.803915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.804020 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.804231 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.804458 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.804562 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.804797 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.804893 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.805105 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.805204 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.805442 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.805637 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.805775 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.805881 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.806104 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.806209 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.806415 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.806507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.806734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.806839 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.807062 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.807153 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.807375 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.807466 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.807692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.807792 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.808007 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.808106 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.808339 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.808478 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.808633 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.808734 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.808947 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.809038 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.809259 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.809357 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.809597 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.809739 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.809914 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.810041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.810225 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.810335 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.810537 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.810631 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.810848 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.811008 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.811219 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.811322 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.811567 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.811778 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.811893 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.812113 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.812212 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.812433 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.812527 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.812753 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.812846 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.813070 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.813164 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.813391 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.813495 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.813748 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.813842 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.814064 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.814152 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.814375 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.814475 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.814691 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.814792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.815005 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.815111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.815337 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.815460 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.815664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.815765 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.815997 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.816104 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.816337 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.816438 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.816656 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.816755 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.816975 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.817077 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.817295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.817388 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.817636 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.817745 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.817997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.818089 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.818315 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.818404 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.818629 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.818725 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.818947 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.819052 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.819267 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.819367 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.819593 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.819694 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.819904 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.820004 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.820221 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.820365 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.820531 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.820632 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.820842 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.820934 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.821153 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.821286 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.821467 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.821607 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.821810 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.821900 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.822122 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.822212 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.822432 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.822533 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.822747 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.822839 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.823057 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.823156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.823366 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.823458 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.823678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.823768 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.823988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.824080 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.824300 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.824507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.824605 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.824827 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.824927 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.825164 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.825265 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.825492 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.825612 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.825827 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.825919 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.826139 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.826240 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.826452 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.826550 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.826806 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.826905 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.827120 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.827213 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.827429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.827547 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.827738 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.827869 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.828048 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.828142 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.828354 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.828447 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.828682 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.828782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.828996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.829089 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.829306 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.829432 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.829653 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.829765 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.829967 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.830070 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.830282 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.830508 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.830636 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.830867 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.830971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.831193 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.831293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.831528 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.831621 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.831862 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.831965 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.832175 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.832273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.832490 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.832632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.832806 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.832897 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.833121 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.833212 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.833428 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.833555 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.833766 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.833857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.834081 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.834173 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.834394 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.834500 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.834709 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.834810 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.835026 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.835117 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.835340 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.835440 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.835652 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.835744 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.835969 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.836068 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.836281 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.836382 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.836614 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.836704 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.836923 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.837012 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.837232 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.837324 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.837574 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.837683 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.837881 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.838018 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.838190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.838283 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.838500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.838592 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.838811 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.838909 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.839117 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.839217 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.839434 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.839534 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.839744 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.839845 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.840060 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.840163 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.840371 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.840463 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.840688 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.840791 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.840997 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.841096 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.841310 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.841410 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.841692 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.841801 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.842020 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.842099 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.842378 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.842471 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.842690 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.842790 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.842939 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 19:07:17.843046 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.843313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.844252 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.844589 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.844918 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.845282 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.845637 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.846182 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.846529 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.846858 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.847198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.847537 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.847853 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.848167 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.848480 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.848811 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.849130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.849448 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.849793 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.850112 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.850422 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.850738 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.851054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.851368 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.851681 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.851994 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.852307 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.852620 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.852947 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.853294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.853647 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.854359 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.854359 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.854573 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.854892 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.855206 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.855523 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.855838 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.856159 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.856495 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.856814 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.857220 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.857601 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.857902 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.858232 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.858561 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.858879 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.859207 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.859534 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.859855 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.860185 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.860502 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.860836 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.861591 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.861732 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.861969 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.862400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.862592 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.862924 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.863239 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.863559 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.863874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.864186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.864496 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.864813 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.865125 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.865435 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.865773 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.866090 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.866402 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.866710 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.866923 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_db.sqlalchemy.engines [None req-32a5de86-709a-473f-ae75-b599b52ed066 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 19:07:17.867081 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.867316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.867625 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.867935 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.868245 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.868558 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.868873 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.869185 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.869502 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.869857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.870169 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.870511 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.870854 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.871180 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.871512 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.871833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.872163 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.872482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.872817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.873142 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.873507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.873901 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.874246 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.874605 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.874927 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.875247 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.875565 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.875881 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.876199 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.876537 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.876869 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.877186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.877514 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.877869 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.878198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.878519 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.878841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.879178 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.879499 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.879815 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.880137 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.880475 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.880774 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.881105 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.881416 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.881787 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.882118 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.882434 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.882765 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.883105 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.883460 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.883778 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.884133 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.884467 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.884793 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.885222 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.885550 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 19:07:17.885814 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 19:07:17.909753 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_db.sqlalchemy.engines [None req-6b9e07a8-7477-4b13-9b69-4448f1aa098a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 19:07:17.931608 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.context [None req-32a5de86-709a-473f-ae75-b599b52ed066 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f(cell1) {{(pid=117274) load_cells /opt/stack/nova/nova/context.py:464}} May 16 19:07:17.936001 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-32a5de86-709a-473f-ae75-b599b52ed066 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:07:17.937668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-32a5de86-709a-473f-ae75-b599b52ed066 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:07:17.938491 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-32a5de86-709a-473f-ae75-b599b52ed066 None None] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:07:17.940451 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-32a5de86-709a-473f-ae75-b599b52ed066 None None] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:07:17.952090 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_db.sqlalchemy.engines [None req-32a5de86-709a-473f-ae75-b599b52ed066 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 19:07:17.954089 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_db.sqlalchemy.engines [None req-32a5de86-709a-473f-ae75-b599b52ed066 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 19:07:17.974306 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.context [None req-6b9e07a8-7477-4b13-9b69-4448f1aa098a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f(cell1) {{(pid=117275) load_cells /opt/stack/nova/nova/context.py:464}} May 16 19:07:17.978751 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6b9e07a8-7477-4b13-9b69-4448f1aa098a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:07:17.980354 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6b9e07a8-7477-4b13-9b69-4448f1aa098a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:07:17.981176 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6b9e07a8-7477-4b13-9b69-4448f1aa098a None None] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:07:17.983203 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6b9e07a8-7477-4b13-9b69-4448f1aa098a None None] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:07:17.994760 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_db.sqlalchemy.engines [None req-6b9e07a8-7477-4b13-9b69-4448f1aa098a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 19:07:17.996116 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_db.sqlalchemy.engines [None req-6b9e07a8-7477-4b13-9b69-4448f1aa098a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 19:07:18.111553 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_db.sqlalchemy.engines [None req-32a5de86-709a-473f-ae75-b599b52ed066 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 19:07:18.155282 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_db.sqlalchemy.engines [None req-6b9e07a8-7477-4b13-9b69-4448f1aa098a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 19:07:18.431930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: WARNING keystonemiddleware.auth_token [None req-32a5de86-709a-473f-ae75-b599b52ed066 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 19:07:18.439627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: WARNING keystonemiddleware.auth_token [None req-32a5de86-709a-473f-ae75-b599b52ed066 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 19:07:18.486181 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: WARNING keystonemiddleware.auth_token [None req-6b9e07a8-7477-4b13-9b69-4448f1aa098a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 19:07:18.494494 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: WARNING keystonemiddleware.auth_token [None req-6b9e07a8-7477-4b13-9b69-4448f1aa098a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 19:07:18.794156 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: WARNING keystonemiddleware.auth_token [None req-32a5de86-709a-473f-ae75-b599b52ed066 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 19:07:18.800499 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: WARNING keystonemiddleware.auth_token [None req-32a5de86-709a-473f-ae75-b599b52ed066 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 19:07:18.805677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bc46de79c0 pid: 117274 (default app) May 16 19:07:18.850518 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: WARNING keystonemiddleware.auth_token [None req-6b9e07a8-7477-4b13-9b69-4448f1aa098a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 19:07:18.856842 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: WARNING keystonemiddleware.auth_token [None req-6b9e07a8-7477-4b13-9b69-4448f1aa098a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 19:07:18.862356 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bc46de79c0 pid: 117275 (default app) May 16 19:08:03.969358 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-952bb378-88fc-4db6-b34c-0c2aa189c408 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] Calling method '.version_select at 0x7f1e1a68df70>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:04.174580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-6f2b9bad-bd50-4ba2-8691-75e7de96b651 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1288319469", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452", "networks": [{"uuid": "2f78bc8d-76d3-44f5-ae2e-dbefa59c5db5"}]}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:04.500965 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-952bb378-88fc-4db6-b34c-0c2aa189c408 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/b139e060-6e2c-4a12-b4e9-3444765eb810" status: 200 len: 350 microversion: 2.1 time: 0.832709 May 16 19:08:04.510699 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 1/1] 10.222.0.24 () {58 vars in 1244 bytes} [Mon May 16 19:08:03 2022] GET /compute/v2.1/os-volumes/b139e060-6e2c-4a12-b4e9-3444765eb810 => generated 350 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:08:04.596514 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.network.neutron [None req-6f2b9bad-bd50-4ba2-8691-75e7de96b651 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] validate_networks() for [('2f78bc8d-76d3-44f5-ae2e-dbefa59c5db5', None, None, None, None, None)] {{(pid=117274) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:08:06.192347 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-24356cb5-007c-4488-8cfc-ddd305a64063 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] Calling method '.version_select at 0x7f1e1a529280>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:06.278087 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-24356cb5-007c-4488-8cfc-ddd305a64063 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/6165044f-d31c-4ae3-b964-bdc27280081f" status: 200 len: 350 microversion: 2.1 time: 0.090967 May 16 19:08:06.280503 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 2/2] 10.222.0.24 () {58 vars in 1244 bytes} [Mon May 16 19:08:06 2022] GET /compute/v2.1/os-volumes/6165044f-d31c-4ae3-b964-bdc27280081f => generated 350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:08:08.247042 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-a618014a-0370-4d5d-96d1-f5a41c0c01b6 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] Calling method '.version_select at 0x7f1e1a5299d0>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:08.345315 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-a618014a-0370-4d5d-96d1-f5a41c0c01b6 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/24cf7246-bb17-4619-bd6c-87a41e45640c" status: 200 len: 351 microversion: 2.1 time: 0.102611 May 16 19:08:08.349105 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 3/3] 10.222.0.24 () {58 vars in 1244 bytes} [Mon May 16 19:08:08 2022] GET /compute/v2.1/os-volumes/24cf7246-bb17-4619-bd6c-87a41e45640c => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:08:08.361921 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e70a3dc8-0e10-4dd3-a084-7c4401c84ed6 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] Calling method '.version_select at 0x7f1e1a529af0>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:08.586178 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e70a3dc8-0e10-4dd3-a084-7c4401c84ed6 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.229180 May 16 19:08:08.587234 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 4/4] 10.222.0.24 () {58 vars in 1133 bytes} [Mon May 16 19:08:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:08.601182 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1e068fb7-ba17-4eb6-8df5-013921a9e084 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] Calling method '.version_select at 0x7f1e1a5290d0>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:08.849564 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1e068fb7-ba17-4eb6-8df5-013921a9e084 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.252106 May 16 19:08:08.850147 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 5/5] 10.222.0.24 () {58 vars in 1148 bytes} [Mon May 16 19:08:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:08:08.864307 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-34ad0e1b-9f77-416b-83e4-63db7ba20715 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] Calling method '.version_select at 0x7f1e1a529040>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:08.908250 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-6f2b9bad-bd50-4ba2-8691-75e7de96b651 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Flavor limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:08:08.908656 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-6f2b9bad-bd50-4ba2-8691-75e7de96b651 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Image limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:08:08.909068 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-6f2b9bad-bd50-4ba2-8691-75e7de96b651 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Flavor pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:08:08.909473 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-6f2b9bad-bd50-4ba2-8691-75e7de96b651 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Image pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:08:08.910335 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-6f2b9bad-bd50-4ba2-8691-75e7de96b651 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:08:08.953059 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6f2b9bad-bd50-4ba2-8691-75e7de96b651 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:08.953517 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6f2b9bad-bd50-4ba2-8691-75e7de96b651 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:08.954345 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6f2b9bad-bd50-4ba2-8691-75e7de96b651 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:08.954781 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6f2b9bad-bd50-4ba2-8691-75e7de96b651 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:09.069172 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-6f2b9bad-bd50-4ba2-8691-75e7de96b651 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Getting quotas for project 6c29e44eba604e6389ecb2ee2b1059a0. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:08:09.112149 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-6f2b9bad-bd50-4ba2-8691-75e7de96b651 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Getting quotas for user e6a312fd71b944188c56c42c94e15324 and project 6c29e44eba604e6389ecb2ee2b1059a0. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:08:09.184139 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-6f2b9bad-bd50-4ba2-8691-75e7de96b651 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Going to run 1 instances... {{(pid=117274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:08:09.192356 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-34ad0e1b-9f77-416b-83e4-63db7ba20715 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.332159 May 16 19:08:09.193102 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 6/6] 10.222.0.24 () {58 vars in 1133 bytes} [Mon May 16 19:08:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:09.210673 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4e3c6aa2-7934-41e8-88f5-619a9fb5b52f tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] Calling method '.version_select at 0x7f1e1a529e50>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:09.213006 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-6f2b9bad-bd50-4ba2-8691-75e7de96b651 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:08:09.452199 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-6f2b9bad-bd50-4ba2-8691-75e7de96b651 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.962279 May 16 19:08:09.452796 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4e3c6aa2-7934-41e8-88f5-619a9fb5b52f tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.247019 May 16 19:08:09.456071 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 7/7] 10.222.0.24 () {58 vars in 1166 bytes} [Mon May 16 19:08:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:08:09.470050 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-7f2eaf17-7a9a-471e-8b3b-7b643a5a57b9 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] Calling method '.version_select at 0x7f1e1a4bab80>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:09.474701 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 1/8] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:08:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 5987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:08:09.507150 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d0ffdefa-8648-49dc-a5ce-2a9dd5382c78 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:09.507802 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d0ffdefa-8648-49dc-a5ce-2a9dd5382c78 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:09.734319 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-7f2eaf17-7a9a-471e-8b3b-7b643a5a57b9 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.270021 May 16 19:08:09.734999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 8/9] 10.222.0.24 () {58 vars in 1169 bytes} [Mon May 16 19:08:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:08:09.758137 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d0d52a11-6859-473c-9404-f76d86a12915 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] Calling method '.version_select at 0x7f1e1a4bae50>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:09.893553 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d0d52a11-6859-473c-9404-f76d86a12915 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.143491 May 16 19:08:09.894705 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 9/10] 10.222.0.24 () {58 vars in 1154 bytes} [Mon May 16 19:08:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:09.926207 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d0ffdefa-8648-49dc-a5ce-2a9dd5382c78 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:09.952946 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d0ffdefa-8648-49dc-a5ce-2a9dd5382c78 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1215 microversion: 2.1 time: 0.475141 May 16 19:08:09.969380 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 2/11] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:09 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1215 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:09.995047 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4e189120-eb9f-4397-8f35-de5490b8c810 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] Calling method '.version_select at 0x7f1e193fdd30>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:10.219729 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-2da3d832-d251-487c-b4ac-44a8ac8a3759 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Action: 'create', calling method: .version_select at 0x7f1e1a529dc0>, body: {"keypair": {"name": "tempest-keypair-710375608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEipqi/KlF5cZp8on6IIril9LrgPhbkKiR2613ZYMt58kgwpyit1bUM45J26wvedcz1+2oG0KtlOl4WbJvGax+2SJqhl1TpkqSa40vc3SEsQJZSjV/NsdR1BD/rWRjdqA=="}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:10.321318 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-2da3d832-d251-487c-b4ac-44a8ac8a3759 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Getting quotas for project dee1963e977f4ac7b6d1877a6dd740a9. Resources: {'key_pairs'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:08:10.328458 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4e189120-eb9f-4397-8f35-de5490b8c810 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.354820 May 16 19:08:10.329365 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 3/12] 10.222.0.24 () {58 vars in 1187 bytes} [Mon May 16 19:08:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:08:10.342225 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-34f774fd-bbef-4582-a281-3911de3f3a16 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] Calling method '.version_select at 0x7f1e193ebb80>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:10.351687 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-2da3d832-d251-487c-b4ac-44a8ac8a3759 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Getting quotas for user a7d2aea046214bfcbbe6d5b3581fc155 and project dee1963e977f4ac7b6d1877a6dd740a9. Resources: {'key_pairs'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:08:10.501887 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-2da3d832-d251-487c-b4ac-44a8ac8a3759 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.605463 May 16 19:08:10.503811 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 10/13] 10.222.0.24 () {60 vars in 1158 bytes} [Mon May 16 19:08:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:08:10.572894 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-34f774fd-bbef-4582-a281-3911de3f3a16 tempest-VolumesTestJSON-1890238679 tempest-VolumesTestJSON-1890238679-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.235416 May 16 19:08:10.573473 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 4/14] 10.222.0.24 () {58 vars in 1154 bytes} [Mon May 16 19:08:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:08:10.987437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-18b44c9d-001a-4faa-ac2c-b7ceb1ca0201 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:10.988571 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-18b44c9d-001a-4faa-ac2c-b7ceb1ca0201 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:11.261573 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-18b44c9d-001a-4faa-ac2c-b7ceb1ca0201 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:11.302669 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-18b44c9d-001a-4faa-ac2c-b7ceb1ca0201 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1215 microversion: 2.1 time: 0.327460 May 16 19:08:11.304686 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 11/15] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:10 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1215 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:12.323147 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f4be0273-fc6b-4bf3-9b11-b80e19c6c26d tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:12.324720 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f4be0273-fc6b-4bf3-9b11-b80e19c6c26d tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:12.368439 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f4be0273-fc6b-4bf3-9b11-b80e19c6c26d tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:12.368987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f4be0273-fc6b-4bf3-9b11-b80e19c6c26d tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:12.374371 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f4be0273-fc6b-4bf3-9b11-b80e19c6c26d tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:12.378619 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f4be0273-fc6b-4bf3-9b11-b80e19c6c26d tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:12.972456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f4be0273-fc6b-4bf3-9b11-b80e19c6c26d tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:12.994978 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f4be0273-fc6b-4bf3-9b11-b80e19c6c26d tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1267 microversion: 2.1 time: 0.677987 May 16 19:08:12.995968 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 5/16] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:12 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1267 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:14.013338 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-eefade47-82e7-4bfc-ad62-285c9cac536e tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:14.015121 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-eefade47-82e7-4bfc-ad62-285c9cac536e tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:14.033091 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eefade47-82e7-4bfc-ad62-285c9cac536e tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:14.036557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eefade47-82e7-4bfc-ad62-285c9cac536e tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:14.037688 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eefade47-82e7-4bfc-ad62-285c9cac536e tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:14.041839 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eefade47-82e7-4bfc-ad62-285c9cac536e tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:14.604120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-52a146ca-48c9-4478-81fa-0b0ddf8534cc tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-780728317", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5657b193-1d9d-4ab0-bc85-4249fb974f7c"}], "security_groups": [{"name": "tempest-securitygroup--1738543449"}], "key_name": "tempest-keypair-710375608", "user_data": "}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:14.667933 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-eefade47-82e7-4bfc-ad62-285c9cac536e tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:14.706175 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-eefade47-82e7-4bfc-ad62-285c9cac536e tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1273 microversion: 2.1 time: 0.697479 May 16 19:08:14.710305 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 12/17] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:14 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1273 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:15.340666 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.network.neutron [None req-52a146ca-48c9-4478-81fa-0b0ddf8534cc tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] validate_networks() for [('5657b193-1d9d-4ab0-bc85-4249fb974f7c', None, None, None, None, None)] {{(pid=117274) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:08:16.480547 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-739c9125-fbaf-4fdc-ab12-f87f83b830bb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Action: 'create', calling method: .version_select at 0x7f1e19c57b80>, body: {"keypair": {"name": "tempest-keypair-2043655114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAb9MdCkq/U0FUPa4rqkr+07f+4xlJYKdPKHV3rsG5Fo/iddAhCv3OMppql/Xi7VRBQieYae+nf24XQShvfNTyDnaSeXj/0mXtOZ6+apBa3rkhN1kZffFeR4g87xd8MedQ=="}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:16.520845 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-739c9125-fbaf-4fdc-ab12-f87f83b830bb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Getting quotas for project 70432660a05b4b169939f7048c545bfc. Resources: {'key_pairs'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:08:16.546599 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-739c9125-fbaf-4fdc-ab12-f87f83b830bb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Getting quotas for user 661228875e4d4c60a558656b46ea650b and project 70432660a05b4b169939f7048c545bfc. Resources: {'key_pairs'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:08:16.623979 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-739c9125-fbaf-4fdc-ab12-f87f83b830bb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.193099 May 16 19:08:16.629091 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 13/18] 10.222.0.24 () {62 vars in 1199 bytes} [Mon May 16 19:08:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1199 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 19:08:16.639251 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1b3e232e-9a76-4abe-9140-f8175b1bc478 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:16.642071 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1b3e232e-9a76-4abe-9140-f8175b1bc478 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:16.670550 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1b3e232e-9a76-4abe-9140-f8175b1bc478 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:16.674078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1b3e232e-9a76-4abe-9140-f8175b1bc478 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:16.675125 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1b3e232e-9a76-4abe-9140-f8175b1bc478 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:16.675935 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1b3e232e-9a76-4abe-9140-f8175b1bc478 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:16.983502 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1b3e232e-9a76-4abe-9140-f8175b1bc478 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:16.993226 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1b3e232e-9a76-4abe-9140-f8175b1bc478 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1273 microversion: 2.1 time: 0.355031 May 16 19:08:16.994365 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 14/19] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:16 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1273 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:18.018453 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0e513669-f06f-48e1-8c78-12d824e66440 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:18.030836 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0e513669-f06f-48e1-8c78-12d824e66440 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:18.045804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0e513669-f06f-48e1-8c78-12d824e66440 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:18.050318 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0e513669-f06f-48e1-8c78-12d824e66440 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:18.051622 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0e513669-f06f-48e1-8c78-12d824e66440 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:18.053383 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0e513669-f06f-48e1-8c78-12d824e66440 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:18.438659 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0e513669-f06f-48e1-8c78-12d824e66440 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:18.450290 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0e513669-f06f-48e1-8c78-12d824e66440 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1273 microversion: 2.1 time: 0.440914 May 16 19:08:18.451199 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 15/20] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:18 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1273 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:08:19.471013 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b9363ff3-5c0e-4c75-8fda-cf5a62466153 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:19.471757 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b9363ff3-5c0e-4c75-8fda-cf5a62466153 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:19.478821 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b9363ff3-5c0e-4c75-8fda-cf5a62466153 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:19.504517 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b9363ff3-5c0e-4c75-8fda-cf5a62466153 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:19.505584 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b9363ff3-5c0e-4c75-8fda-cf5a62466153 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:19.509035 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b9363ff3-5c0e-4c75-8fda-cf5a62466153 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:20.039973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b9363ff3-5c0e-4c75-8fda-cf5a62466153 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:20.062201 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b9363ff3-5c0e-4c75-8fda-cf5a62466153 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1273 microversion: 2.1 time: 0.586592 May 16 19:08:20.063177 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 16/21] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:19 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1273 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:20.580297 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-52a146ca-48c9-4478-81fa-0b0ddf8534cc tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Flavor limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:08:20.581737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-52a146ca-48c9-4478-81fa-0b0ddf8534cc tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Image limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:08:20.582788 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-52a146ca-48c9-4478-81fa-0b0ddf8534cc tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Flavor pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:08:20.583515 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-52a146ca-48c9-4478-81fa-0b0ddf8534cc tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Image pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:08:20.584144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-52a146ca-48c9-4478-81fa-0b0ddf8534cc tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:08:20.604477 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-52a146ca-48c9-4478-81fa-0b0ddf8534cc tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:20.606974 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-52a146ca-48c9-4478-81fa-0b0ddf8534cc tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:20.612059 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-52a146ca-48c9-4478-81fa-0b0ddf8534cc tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:20.615080 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-52a146ca-48c9-4478-81fa-0b0ddf8534cc tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:20.675520 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-52a146ca-48c9-4478-81fa-0b0ddf8534cc tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Getting quotas for project dee1963e977f4ac7b6d1877a6dd740a9. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:08:20.688016 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-52a146ca-48c9-4478-81fa-0b0ddf8534cc tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Getting quotas for user a7d2aea046214bfcbbe6d5b3581fc155 and project dee1963e977f4ac7b6d1877a6dd740a9. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:08:20.723485 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-52a146ca-48c9-4478-81fa-0b0ddf8534cc tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Going to run 1 instances... {{(pid=117274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:08:20.730430 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-52a146ca-48c9-4478-81fa-0b0ddf8534cc tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:08:20.872606 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-52a146ca-48c9-4478-81fa-0b0ddf8534cc tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.268122 May 16 19:08:20.881246 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 6/22] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:08:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 6283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:08:20.888589 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5aaf4ef4-de2c-4f87-af22-549dbf072f5f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:20.905790 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5aaf4ef4-de2c-4f87-af22-549dbf072f5f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:21.134634 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-a48dfd45-9b93-4a68-9430-aa86c8d461f0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Action: 'create', calling method: .version_select at 0x7f1e19b358b0>, body: {"keypair": {"name": "tempest-keypair-1530757485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2ZZR12UftR2cOgnxg3Z7mgc9E2GWr64grGCnlhosl5HzrSq+r2dPpjyOXiSqR3jccUk5ocMUBFEtAFtb+lqXjszSejIWHdTFi718aYdKnA2s1W7a4gayloFE4dgdMoRg=="}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:21.213858 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-a48dfd45-9b93-4a68-9430-aa86c8d461f0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Getting quotas for project dd195af6f92c42a18ed7051eae26dbaa. Resources: {'key_pairs'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:08:21.242962 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-a48dfd45-9b93-4a68-9430-aa86c8d461f0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Getting quotas for user 7d3af11e1ffc4ab1a37669f893d2f3be and project dd195af6f92c42a18ed7051eae26dbaa. Resources: {'key_pairs'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:08:21.272877 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-5aaf4ef4-de2c-4f87-af22-549dbf072f5f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:21.288153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-5aaf4ef4-de2c-4f87-af22-549dbf072f5f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1236 microversion: 2.1 time: 0.402536 May 16 19:08:21.298229 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 7/23] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:20 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1236 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:21.326302 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a3be2440-2354-4943-95ef-3c124797d427 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:21.332819 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a3be2440-2354-4943-95ef-3c124797d427 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:21.379237 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-a48dfd45-9b93-4a68-9430-aa86c8d461f0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.888975 May 16 19:08:21.380120 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 17/24] 10.222.0.24 () {60 vars in 1158 bytes} [Mon May 16 19:08:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:08:21.390011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a3be2440-2354-4943-95ef-3c124797d427 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:21.390548 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a3be2440-2354-4943-95ef-3c124797d427 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:21.396461 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a3be2440-2354-4943-95ef-3c124797d427 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:21.397237 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a3be2440-2354-4943-95ef-3c124797d427 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:22.308902 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5400e14b-63e7-4420-a36b-9d4fb092763c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:22.309465 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a3be2440-2354-4943-95ef-3c124797d427 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:22.311833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5400e14b-63e7-4420-a36b-9d4fb092763c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:22.325504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a3be2440-2354-4943-95ef-3c124797d427 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1315 microversion: 2.1 time: 1.018935 May 16 19:08:22.348800 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 8/25] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:21 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1315 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:22.453470 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5400e14b-63e7-4420-a36b-9d4fb092763c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:22.467663 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5400e14b-63e7-4420-a36b-9d4fb092763c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1236 microversion: 2.1 time: 0.163140 May 16 19:08:22.470564 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 18/26] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:22 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1236 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:23.367376 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-1dabc880-c880-4d0d-b494-4329f0bb809b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:23.369052 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-1dabc880-c880-4d0d-b494-4329f0bb809b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:23.381454 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1dabc880-c880-4d0d-b494-4329f0bb809b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:23.391409 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1dabc880-c880-4d0d-b494-4329f0bb809b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:23.392717 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1dabc880-c880-4d0d-b494-4329f0bb809b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:23.393382 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1dabc880-c880-4d0d-b494-4329f0bb809b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:23.500886 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8426d806-4a63-4f81-b1ef-aa621885d420 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:23.501297 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8426d806-4a63-4f81-b1ef-aa621885d420 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:23.508043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8426d806-4a63-4f81-b1ef-aa621885d420 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:23.508743 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8426d806-4a63-4f81-b1ef-aa621885d420 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:23.509725 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8426d806-4a63-4f81-b1ef-aa621885d420 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:23.510557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8426d806-4a63-4f81-b1ef-aa621885d420 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:23.666632 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8426d806-4a63-4f81-b1ef-aa621885d420 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:23.689365 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8426d806-4a63-4f81-b1ef-aa621885d420 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1288 microversion: 2.1 time: 0.206110 May 16 19:08:23.690862 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 19/27] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:23 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1288 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:24.438235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-1dabc880-c880-4d0d-b494-4329f0bb809b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:24.454447 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-1dabc880-c880-4d0d-b494-4329f0bb809b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1315 microversion: 2.1 time: 1.092586 May 16 19:08:24.455210 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 9/28] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:23 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1315 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:24.710025 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ed11a624-f767-4aa8-908b-58308f047037 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:24.711831 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ed11a624-f767-4aa8-908b-58308f047037 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:24.721960 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ed11a624-f767-4aa8-908b-58308f047037 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:24.723225 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ed11a624-f767-4aa8-908b-58308f047037 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:24.726031 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ed11a624-f767-4aa8-908b-58308f047037 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:24.727625 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ed11a624-f767-4aa8-908b-58308f047037 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:25.019551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ed11a624-f767-4aa8-908b-58308f047037 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:25.029189 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ed11a624-f767-4aa8-908b-58308f047037 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1294 microversion: 2.1 time: 0.322974 May 16 19:08:25.040113 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 20/29] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:24 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1294 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:25.471804 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d452e544-f0fb-4a16-930f-08272d3f2e70 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:25.473440 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d452e544-f0fb-4a16-930f-08272d3f2e70 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:25.489740 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d452e544-f0fb-4a16-930f-08272d3f2e70 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:25.490702 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d452e544-f0fb-4a16-930f-08272d3f2e70 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:25.491778 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d452e544-f0fb-4a16-930f-08272d3f2e70 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:25.492534 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d452e544-f0fb-4a16-930f-08272d3f2e70 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:26.047196 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f535d9cf-ea80-4113-a986-e7f5f0cdb229 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:26.048485 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f535d9cf-ea80-4113-a986-e7f5f0cdb229 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:26.058703 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f535d9cf-ea80-4113-a986-e7f5f0cdb229 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:26.068288 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f535d9cf-ea80-4113-a986-e7f5f0cdb229 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:26.079410 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f535d9cf-ea80-4113-a986-e7f5f0cdb229 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:26.081902 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f535d9cf-ea80-4113-a986-e7f5f0cdb229 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:26.211738 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d452e544-f0fb-4a16-930f-08272d3f2e70 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:26.219719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d452e544-f0fb-4a16-930f-08272d3f2e70 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1315 microversion: 2.1 time: 0.751854 May 16 19:08:26.220268 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 10/30] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:25 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:27.083235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a1680670-5510-427f-b99d-beabe03280f5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-492216155", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:27.299841 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.network.neutron [None req-a1680670-5510-427f-b99d-beabe03280f5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] validate_networks() for [('b0160fa7-2bfb-4bc1-8d58-6361ff669d8e', None, None, None, None, None)] {{(pid=117274) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:08:27.898140 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f535d9cf-ea80-4113-a986-e7f5f0cdb229 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:27.908625 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f535d9cf-ea80-4113-a986-e7f5f0cdb229 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1294 microversion: 2.1 time: 1.865307 May 16 19:08:27.920612 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 21/31] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:26 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1294 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:27.931811 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-a1b41869-c499-4428-96c1-677011c32bb5 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:27.933180 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-a1b41869-c499-4428-96c1-677011c32bb5 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:27.978723 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a1b41869-c499-4428-96c1-677011c32bb5 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:27.979093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a1b41869-c499-4428-96c1-677011c32bb5 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:27.983381 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a1b41869-c499-4428-96c1-677011c32bb5 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:27.983381 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a1b41869-c499-4428-96c1-677011c32bb5 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:29.862045 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-a1b41869-c499-4428-96c1-677011c32bb5 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:29.879283 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-a1b41869-c499-4428-96c1-677011c32bb5 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1315 microversion: 2.1 time: 1.957257 May 16 19:08:29.881588 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 22/32] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:27 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1315 bytes in 1960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:29.908301 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-fa18d6ae-175d-4d4a-a7b0-e18659da5b44 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:29.911377 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-fa18d6ae-175d-4d4a-a7b0-e18659da5b44 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:29.930790 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fa18d6ae-175d-4d4a-a7b0-e18659da5b44 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:29.933525 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fa18d6ae-175d-4d4a-a7b0-e18659da5b44 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:29.934479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fa18d6ae-175d-4d4a-a7b0-e18659da5b44 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:29.936084 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fa18d6ae-175d-4d4a-a7b0-e18659da5b44 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:30.195402 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-a1680670-5510-427f-b99d-beabe03280f5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Flavor limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:08:30.195904 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-a1680670-5510-427f-b99d-beabe03280f5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Image limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:08:30.196319 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-a1680670-5510-427f-b99d-beabe03280f5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Flavor pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:08:30.196734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-a1680670-5510-427f-b99d-beabe03280f5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Image pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:08:30.197146 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-a1680670-5510-427f-b99d-beabe03280f5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:08:30.213637 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a1680670-5510-427f-b99d-beabe03280f5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:30.214079 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a1680670-5510-427f-b99d-beabe03280f5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:30.214882 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a1680670-5510-427f-b99d-beabe03280f5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:30.215320 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a1680670-5510-427f-b99d-beabe03280f5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:30.264904 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-a1680670-5510-427f-b99d-beabe03280f5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Getting quotas for project ba2c6e5fee5b402fa68833228d12c8e7. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:08:30.270560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-a1680670-5510-427f-b99d-beabe03280f5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Getting quotas for user 1673e91c8910435499a5d587f4ef59f9 and project ba2c6e5fee5b402fa68833228d12c8e7. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:08:30.283875 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a1680670-5510-427f-b99d-beabe03280f5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Going to run 1 instances... {{(pid=117274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:08:30.286258 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a1680670-5510-427f-b99d-beabe03280f5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:08:30.345077 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a1680670-5510-427f-b99d-beabe03280f5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.607321 May 16 19:08:30.346506 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 11/33] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:08:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 3609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:08:30.352365 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d28836e1-7a57-4b5b-a138-8f699a5816e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1039107371", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d891ed5e-5c1c-4920-894a-8addbe008c14"}], "security_groups": [{"name": "tempest-securitygroup--1334076048"}], "key_name": "tempest-keypair-2043655114", "user_data": "}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:30.407393 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-fa18d6ae-175d-4d4a-a7b0-e18659da5b44 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:30.419401 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-fa18d6ae-175d-4d4a-a7b0-e18659da5b44 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1362 microversion: 2.1 time: 0.523272 May 16 19:08:30.422764 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 23/34] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:29 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1362 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:30.536407 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-8eef1b22-3e28-4c7d-afd9-e394359f8a05 req-0e8121d8-a54a-4723-ba08-2261330101c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39fb145-de7f-49c4-ac8f-eacbb6c9a673", "tag": "2e11282d-6548-42a2-bd7b-f48e111161b1"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:30.556052 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.network.neutron [None req-d28836e1-7a57-4b5b-a138-8f699a5816e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] validate_networks() for [('d891ed5e-5c1c-4920-894a-8addbe008c14', None, None, None, None, None)] {{(pid=117274) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:08:30.560111 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-8eef1b22-3e28-4c7d-afd9-e394359f8a05 req-0e8121d8-a54a-4723-ba08-2261330101c9 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:30.570760 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-8eef1b22-3e28-4c7d-afd9-e394359f8a05 req-0e8121d8-a54a-4723-ba08-2261330101c9 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:30.605643 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-8eef1b22-3e28-4c7d-afd9-e394359f8a05 req-0e8121d8-a54a-4723-ba08-2261330101c9 service nova] Creating event network-changed:2e11282d-6548-42a2-bd7b-f48e111161b1 for instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 on hv-cinder-76606 May 16 19:08:30.606736 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-8eef1b22-3e28-4c7d-afd9-e394359f8a05 req-0e8121d8-a54a-4723-ba08-2261330101c9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117275) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 19:08:30.608486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1cfcc84-969a-4371-adef-82f5d3c47c77 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:30.609254 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1cfcc84-969a-4371-adef-82f5d3c47c77 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:30.610978 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1cfcc84-969a-4371-adef-82f5d3c47c77 None None] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:30.611608 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1cfcc84-969a-4371-adef-82f5d3c47c77 None None] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:30.623191 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.compute.rpcapi [None req-d1cfcc84-969a-4371-adef-82f5d3c47c77 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 19:08:30.624503 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1cfcc84-969a-4371-adef-82f5d3c47c77 None None] Releasing lock "compute-rpcapi-router" {{(pid=117275) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 19:08:30.680992 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d1cfcc84-969a-4371-adef-82f5d3c47c77 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255124 May 16 19:08:30.684061 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 24/35] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:08:30.693730 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9d3929cc-24b7-478b-8957-556c538ce771 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:30.701819 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9d3929cc-24b7-478b-8957-556c538ce771 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:30.848610 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-9d3929cc-24b7-478b-8957-556c538ce771 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:30.872733 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9d3929cc-24b7-478b-8957-556c538ce771 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1221 microversion: 2.1 time: 0.177978 May 16 19:08:30.875215 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 25/36] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:30 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1221 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:30.900822 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3e146306-e477-4c14-9861-2c600cec7b49 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:30.905033 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-3e146306-e477-4c14-9861-2c600cec7b49 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:30.923529 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3e146306-e477-4c14-9861-2c600cec7b49 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:30.924455 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3e146306-e477-4c14-9861-2c600cec7b49 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:30.929184 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3e146306-e477-4c14-9861-2c600cec7b49 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:30.929684 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3e146306-e477-4c14-9861-2c600cec7b49 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:31.368365 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-3e146306-e477-4c14-9861-2c600cec7b49 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:31.380710 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-3e146306-e477-4c14-9861-2c600cec7b49 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1315 microversion: 2.1 time: 0.484208 May 16 19:08:31.390592 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 26/37] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:30 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:31.408673 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1158f99d-62e3-455d-903e-a18d8e20a81c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1906139084", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9cbd7ed-b011-47eb-8de6-48451d865294"}], "security_groups": [{"name": "tempest-securitygroup--341687664"}], "key_name": "tempest-keypair-1530757485", "user_data": "}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:31.445785 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-d28836e1-7a57-4b5b-a138-8f699a5816e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Flavor limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:08:31.446246 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-d28836e1-7a57-4b5b-a138-8f699a5816e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Image limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:08:31.446673 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-d28836e1-7a57-4b5b-a138-8f699a5816e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Flavor pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:08:31.447081 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-d28836e1-7a57-4b5b-a138-8f699a5816e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Image pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:08:31.447550 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-d28836e1-7a57-4b5b-a138-8f699a5816e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:08:31.466320 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d28836e1-7a57-4b5b-a138-8f699a5816e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:31.466729 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d28836e1-7a57-4b5b-a138-8f699a5816e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:31.467593 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d28836e1-7a57-4b5b-a138-8f699a5816e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:31.468030 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d28836e1-7a57-4b5b-a138-8f699a5816e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:31.536711 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-d28836e1-7a57-4b5b-a138-8f699a5816e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Getting quotas for project 70432660a05b4b169939f7048c545bfc. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:08:31.546656 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-d28836e1-7a57-4b5b-a138-8f699a5816e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Getting quotas for user 661228875e4d4c60a558656b46ea650b and project 70432660a05b4b169939f7048c545bfc. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:08:31.572983 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d28836e1-7a57-4b5b-a138-8f699a5816e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Going to run 1 instances... {{(pid=117274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:08:31.578874 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d28836e1-7a57-4b5b-a138-8f699a5816e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:08:31.719824 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d28836e1-7a57-4b5b-a138-8f699a5816e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.371813 May 16 19:08:31.722102 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 12/38] 10.222.0.24 () {62 vars in 1187 bytes} [Mon May 16 19:08:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 16 19:08:31.739561 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5a9876d7-d95d-4365-9cab-8403dbc292f8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1022294505", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:31.812043 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.network.neutron [None req-5a9876d7-d95d-4365-9cab-8403dbc292f8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] validate_networks() for [('b0160fa7-2bfb-4bc1-8d58-6361ff669d8e', None, None, None, None, None)] {{(pid=117274) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:08:31.844987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.network.neutron [None req-1158f99d-62e3-455d-903e-a18d8e20a81c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] validate_networks() for [('b9cbd7ed-b011-47eb-8de6-48451d865294', None, None, None, None, None)] {{(pid=117275) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:08:34.283219 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-5a9876d7-d95d-4365-9cab-8403dbc292f8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Flavor limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:08:34.283788 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-5a9876d7-d95d-4365-9cab-8403dbc292f8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Image limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:08:34.284319 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-5a9876d7-d95d-4365-9cab-8403dbc292f8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Flavor pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:08:34.284829 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-5a9876d7-d95d-4365-9cab-8403dbc292f8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Image pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:08:34.285372 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-5a9876d7-d95d-4365-9cab-8403dbc292f8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:08:34.307971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5a9876d7-d95d-4365-9cab-8403dbc292f8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:34.311206 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5a9876d7-d95d-4365-9cab-8403dbc292f8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:34.313107 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5a9876d7-d95d-4365-9cab-8403dbc292f8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:34.317141 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5a9876d7-d95d-4365-9cab-8403dbc292f8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:34.369405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-5a9876d7-d95d-4365-9cab-8403dbc292f8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Getting quotas for project ba2c6e5fee5b402fa68833228d12c8e7. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:08:34.385250 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-5a9876d7-d95d-4365-9cab-8403dbc292f8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Getting quotas for user 1673e91c8910435499a5d587f4ef59f9 and project ba2c6e5fee5b402fa68833228d12c8e7. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:08:34.408124 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5a9876d7-d95d-4365-9cab-8403dbc292f8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Going to run 1 instances... {{(pid=117274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:08:34.411485 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5a9876d7-d95d-4365-9cab-8403dbc292f8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:08:34.508334 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-5a9876d7-d95d-4365-9cab-8403dbc292f8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.783734 May 16 19:08:34.511024 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 13/39] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:08:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:08:34.524034 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d5c00f71-3bf0-404d-9535-1e84c6938e2d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:34.524893 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d5c00f71-3bf0-404d-9535-1e84c6938e2d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:34.532593 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d5c00f71-3bf0-404d-9535-1e84c6938e2d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:34.533401 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d5c00f71-3bf0-404d-9535-1e84c6938e2d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:34.534580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d5c00f71-3bf0-404d-9535-1e84c6938e2d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:34.535238 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d5c00f71-3bf0-404d-9535-1e84c6938e2d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:34.770956 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-1158f99d-62e3-455d-903e-a18d8e20a81c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Flavor limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:08:34.771906 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-1158f99d-62e3-455d-903e-a18d8e20a81c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Image limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:08:34.773062 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-1158f99d-62e3-455d-903e-a18d8e20a81c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Flavor pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:08:34.773449 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-1158f99d-62e3-455d-903e-a18d8e20a81c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Image pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:08:34.773891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-1158f99d-62e3-455d-903e-a18d8e20a81c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:08:34.795443 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1158f99d-62e3-455d-903e-a18d8e20a81c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:34.795907 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1158f99d-62e3-455d-903e-a18d8e20a81c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:34.796724 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1158f99d-62e3-455d-903e-a18d8e20a81c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:34.797176 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1158f99d-62e3-455d-903e-a18d8e20a81c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:34.874561 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-1158f99d-62e3-455d-903e-a18d8e20a81c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Getting quotas for project dd195af6f92c42a18ed7051eae26dbaa. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:08:34.883528 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-1158f99d-62e3-455d-903e-a18d8e20a81c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Getting quotas for user 7d3af11e1ffc4ab1a37669f893d2f3be and project dd195af6f92c42a18ed7051eae26dbaa. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:08:34.920753 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1158f99d-62e3-455d-903e-a18d8e20a81c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Going to run 1 instances... {{(pid=117275) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:08:34.924016 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1158f99d-62e3-455d-903e-a18d8e20a81c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:08:35.025363 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1158f99d-62e3-455d-903e-a18d8e20a81c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.633044 May 16 19:08:35.030845 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 27/40] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:08:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 3639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:08:35.035429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d5c00f71-3bf0-404d-9535-1e84c6938e2d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:35.046513 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-62881710-fb15-4f65-b12c-b7f62840d2a8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:35.047137 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-62881710-fb15-4f65-b12c-b7f62840d2a8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:35.050110 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d5c00f71-3bf0-404d-9535-1e84c6938e2d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1362 microversion: 2.1 time: 0.530445 May 16 19:08:35.057270 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 14/41] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:34 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1362 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:35.063916 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-62881710-fb15-4f65-b12c-b7f62840d2a8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:35.064645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-62881710-fb15-4f65-b12c-b7f62840d2a8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:35.066536 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-62881710-fb15-4f65-b12c-b7f62840d2a8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:35.067381 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-62881710-fb15-4f65-b12c-b7f62840d2a8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:35.072532 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-17380015-b5d7-4a40-885c-0715bcdd452d tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:35.074349 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-17380015-b5d7-4a40-885c-0715bcdd452d tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:35.081438 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-17380015-b5d7-4a40-885c-0715bcdd452d tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:35.082113 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-17380015-b5d7-4a40-885c-0715bcdd452d tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:35.084267 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-17380015-b5d7-4a40-885c-0715bcdd452d tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:35.086000 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-17380015-b5d7-4a40-885c-0715bcdd452d tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:35.481883 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-17380015-b5d7-4a40-885c-0715bcdd452d tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:35.502067 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-17380015-b5d7-4a40-885c-0715bcdd452d tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1315 microversion: 2.1 time: 0.424204 May 16 19:08:35.503485 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 15/42] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:35 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:35.508293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a122f82c-fe6b-4e0b-8143-4bd09a998961 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:35.516215 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a122f82c-fe6b-4e0b-8143-4bd09a998961 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:35.529769 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-62881710-fb15-4f65-b12c-b7f62840d2a8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:35.542941 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-62881710-fb15-4f65-b12c-b7f62840d2a8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:35.551725 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a122f82c-fe6b-4e0b-8143-4bd09a998961 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:35.552183 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a122f82c-fe6b-4e0b-8143-4bd09a998961 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:35.554282 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-62881710-fb15-4f65-b12c-b7f62840d2a8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:35.555447 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-62881710-fb15-4f65-b12c-b7f62840d2a8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1340 microversion: 2.20 time: 0.523429 May 16 19:08:35.556019 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 28/43] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:35 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1340 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:08:35.570521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-dc5d2edd-3e33-46b4-ab70-fdfb5676042c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:35.578051 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a122f82c-fe6b-4e0b-8143-4bd09a998961 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:35.578837 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a122f82c-fe6b-4e0b-8143-4bd09a998961 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:35.587992 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-dc5d2edd-3e33-46b4-ab70-fdfb5676042c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:35.777549 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a122f82c-fe6b-4e0b-8143-4bd09a998961 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:35.786368 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a122f82c-fe6b-4e0b-8143-4bd09a998961 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1226 microversion: 2.1 time: 0.281755 May 16 19:08:35.790308 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 16/44] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:35 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1226 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:36.023642 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-dc5d2edd-3e33-46b4-ab70-fdfb5676042c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:36.039876 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-dc5d2edd-3e33-46b4-ab70-fdfb5676042c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1242 microversion: 2.1 time: 0.472069 May 16 19:08:36.040674 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 29/45] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:35 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1242 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:36.077895 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-2e2734e2-abaa-442c-96d6-8a036cf318c5 req-b7adf550-6c29-4132-a148-fc0aaaf0767c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a68fcd6b-1593-4fd4-8915-3153f52105c1", "tag": "f100112e-7e29-4339-bff0-b6f0d938007d"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:36.079691 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b93cd683-6d0a-44e1-8244-d0a0ef9617ef tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:36.080478 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b93cd683-6d0a-44e1-8244-d0a0ef9617ef tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:36.088236 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b93cd683-6d0a-44e1-8244-d0a0ef9617ef tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:36.088854 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b93cd683-6d0a-44e1-8244-d0a0ef9617ef tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:36.089817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b93cd683-6d0a-44e1-8244-d0a0ef9617ef tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:36.090409 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b93cd683-6d0a-44e1-8244-d0a0ef9617ef tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:36.092832 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-2e2734e2-abaa-442c-96d6-8a036cf318c5 req-b7adf550-6c29-4132-a148-fc0aaaf0767c service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:36.093335 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-2e2734e2-abaa-442c-96d6-8a036cf318c5 req-b7adf550-6c29-4132-a148-fc0aaaf0767c service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:36.115314 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-2e2734e2-abaa-442c-96d6-8a036cf318c5 req-b7adf550-6c29-4132-a148-fc0aaaf0767c service nova] Creating event network-changed:f100112e-7e29-4339-bff0-b6f0d938007d for instance a68fcd6b-1593-4fd4-8915-3153f52105c1 on hv-cinder-76606 May 16 19:08:36.115851 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-2e2734e2-abaa-442c-96d6-8a036cf318c5 req-b7adf550-6c29-4132-a148-fc0aaaf0767c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117274) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 19:08:36.117138 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b3f3fbfc-ee53-4db1-87ba-549e4133a774 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:36.117810 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b3f3fbfc-ee53-4db1-87ba-549e4133a774 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:36.118946 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b3f3fbfc-ee53-4db1-87ba-549e4133a774 None None] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:36.119534 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b3f3fbfc-ee53-4db1-87ba-549e4133a774 None None] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:36.140247 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.compute.rpcapi [None req-b3f3fbfc-ee53-4db1-87ba-549e4133a774 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 19:08:36.141887 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b3f3fbfc-ee53-4db1-87ba-549e4133a774 None None] Releasing lock "compute-rpcapi-router" {{(pid=117274) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 19:08:36.171993 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b3f3fbfc-ee53-4db1-87ba-549e4133a774 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.379997 May 16 19:08:36.172609 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 17/46] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:08:36.349411 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b93cd683-6d0a-44e1-8244-d0a0ef9617ef tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:36.361065 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b93cd683-6d0a-44e1-8244-d0a0ef9617ef tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1362 microversion: 2.1 time: 0.290905 May 16 19:08:36.370492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 30/47] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:36 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:36.521683 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9abe0886-d4b9-485f-b58a-851545fab1c6 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:36.522397 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9abe0886-d4b9-485f-b58a-851545fab1c6 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:36.539647 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9abe0886-d4b9-485f-b58a-851545fab1c6 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:36.540111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9abe0886-d4b9-485f-b58a-851545fab1c6 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:36.540920 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9abe0886-d4b9-485f-b58a-851545fab1c6 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:36.541830 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9abe0886-d4b9-485f-b58a-851545fab1c6 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:36.575419 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-97d628b9-fb52-4cab-8016-9f1f2171c45b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:36.576819 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-97d628b9-fb52-4cab-8016-9f1f2171c45b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:36.587650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-97d628b9-fb52-4cab-8016-9f1f2171c45b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:36.588089 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-97d628b9-fb52-4cab-8016-9f1f2171c45b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:36.589124 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-97d628b9-fb52-4cab-8016-9f1f2171c45b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:36.589744 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-97d628b9-fb52-4cab-8016-9f1f2171c45b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:36.815189 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9abe0886-d4b9-485f-b58a-851545fab1c6 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:36.825819 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9abe0886-d4b9-485f-b58a-851545fab1c6 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1315 microversion: 2.1 time: 0.305641 May 16 19:08:36.826458 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 18/48] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:36 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:36.840972 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5d1bfe41-99f7-4180-8120-34e7447a3ad5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:36.841616 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5d1bfe41-99f7-4180-8120-34e7447a3ad5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:36.848844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5d1bfe41-99f7-4180-8120-34e7447a3ad5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:36.849300 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5d1bfe41-99f7-4180-8120-34e7447a3ad5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:36.850125 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5d1bfe41-99f7-4180-8120-34e7447a3ad5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:36.850565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5d1bfe41-99f7-4180-8120-34e7447a3ad5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:36.980234 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-5d1bfe41-99f7-4180-8120-34e7447a3ad5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:36.996932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-5d1bfe41-99f7-4180-8120-34e7447a3ad5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1218 microversion: 2.1 time: 0.169236 May 16 19:08:36.997552 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 19/49] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:36 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:37.064371 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ff3a39e3-62f6-4380-b957-545e4548be96 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:37.064999 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ff3a39e3-62f6-4380-b957-545e4548be96 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:37.067192 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-97d628b9-fb52-4cab-8016-9f1f2171c45b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:37.073683 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ff3a39e3-62f6-4380-b957-545e4548be96 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:37.074142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ff3a39e3-62f6-4380-b957-545e4548be96 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:37.074987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ff3a39e3-62f6-4380-b957-545e4548be96 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:37.075430 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ff3a39e3-62f6-4380-b957-545e4548be96 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:37.079102 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-97d628b9-fb52-4cab-8016-9f1f2171c45b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:37.081333 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-97d628b9-fb52-4cab-8016-9f1f2171c45b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:37.083080 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-97d628b9-fb52-4cab-8016-9f1f2171c45b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.512331 May 16 19:08:37.094223 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 31/50] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:36 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:08:37.184038 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ff3a39e3-62f6-4380-b957-545e4548be96 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:37.194593 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ff3a39e3-62f6-4380-b957-545e4548be96 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1294 microversion: 2.1 time: 0.133978 May 16 19:08:37.205783 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 20/51] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:37 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1294 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:08:37.381792 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0c2930a0-5d44-4ea5-a2ca-03402c580e0d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:37.382786 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0c2930a0-5d44-4ea5-a2ca-03402c580e0d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:37.392384 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0c2930a0-5d44-4ea5-a2ca-03402c580e0d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:37.393099 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0c2930a0-5d44-4ea5-a2ca-03402c580e0d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:37.394221 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0c2930a0-5d44-4ea5-a2ca-03402c580e0d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:37.395558 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0c2930a0-5d44-4ea5-a2ca-03402c580e0d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:37.842954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-491b784f-27eb-4838-9674-feef76d98a42 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:37.843498 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-491b784f-27eb-4838-9674-feef76d98a42 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:37.861053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-491b784f-27eb-4838-9674-feef76d98a42 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:37.873678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-491b784f-27eb-4838-9674-feef76d98a42 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:37.878786 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-491b784f-27eb-4838-9674-feef76d98a42 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:37.880051 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-491b784f-27eb-4838-9674-feef76d98a42 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:37.996661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0c2930a0-5d44-4ea5-a2ca-03402c580e0d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:38.009514 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0c2930a0-5d44-4ea5-a2ca-03402c580e0d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1362 microversion: 2.1 time: 0.635391 May 16 19:08:38.025675 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 32/52] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:37 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1362 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:08:38.032307 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1848bcf2-80bd-4e48-ae96-0c9168a1a3f4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:38.033063 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1848bcf2-80bd-4e48-ae96-0c9168a1a3f4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:38.040178 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1848bcf2-80bd-4e48-ae96-0c9168a1a3f4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:38.040845 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1848bcf2-80bd-4e48-ae96-0c9168a1a3f4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:38.041851 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1848bcf2-80bd-4e48-ae96-0c9168a1a3f4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:38.042446 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1848bcf2-80bd-4e48-ae96-0c9168a1a3f4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:38.235397 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1848bcf2-80bd-4e48-ae96-0c9168a1a3f4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:38.248558 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1848bcf2-80bd-4e48-ae96-0c9168a1a3f4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1282 microversion: 2.1 time: 0.221091 May 16 19:08:38.251578 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 33/53] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:38 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1282 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:38.259250 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-41103f4a-7a28-44c4-9bcf-803e2e9284a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:38.260087 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-41103f4a-7a28-44c4-9bcf-803e2e9284a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:38.286779 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-41103f4a-7a28-44c4-9bcf-803e2e9284a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:38.287402 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-41103f4a-7a28-44c4-9bcf-803e2e9284a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:38.288338 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-41103f4a-7a28-44c4-9bcf-803e2e9284a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:38.290229 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-41103f4a-7a28-44c4-9bcf-803e2e9284a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:38.357996 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-491b784f-27eb-4838-9674-feef76d98a42 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:38.366389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-491b784f-27eb-4838-9674-feef76d98a42 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1315 microversion: 2.1 time: 0.527478 May 16 19:08:38.372450 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 21/54] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:37 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:08:38.386191 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-beeaea9e-60d3-4977-9e81-66d7475acf32 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:38.387059 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-beeaea9e-60d3-4977-9e81-66d7475acf32 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:38.394274 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-beeaea9e-60d3-4977-9e81-66d7475acf32 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:38.395114 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-beeaea9e-60d3-4977-9e81-66d7475acf32 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:38.395950 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-beeaea9e-60d3-4977-9e81-66d7475acf32 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:38.396516 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-beeaea9e-60d3-4977-9e81-66d7475acf32 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:38.592817 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-beeaea9e-60d3-4977-9e81-66d7475acf32 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:38.614959 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-beeaea9e-60d3-4977-9e81-66d7475acf32 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1300 microversion: 2.1 time: 0.240990 May 16 19:08:38.616039 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 22/55] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:38 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1300 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:38.633134 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-00293eb2-613b-4ad4-8aad-4a6934d2314e req-a42f8140-30b7-44da-8347-c115c37972dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cc4667a-a2c3-459c-ac05-45720bc0f622", "tag": "481f3e6e-6d8b-4a1e-96fe-1213734def9a"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:38.654920 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-00293eb2-613b-4ad4-8aad-4a6934d2314e req-a42f8140-30b7-44da-8347-c115c37972dd service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:38.657242 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-00293eb2-613b-4ad4-8aad-4a6934d2314e req-a42f8140-30b7-44da-8347-c115c37972dd service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:38.686592 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-00293eb2-613b-4ad4-8aad-4a6934d2314e req-a42f8140-30b7-44da-8347-c115c37972dd service nova] Creating event network-changed:481f3e6e-6d8b-4a1e-96fe-1213734def9a for instance 9cc4667a-a2c3-459c-ac05-45720bc0f622 on hv-cinder-76606 May 16 19:08:38.699138 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-00293eb2-613b-4ad4-8aad-4a6934d2314e req-a42f8140-30b7-44da-8347-c115c37972dd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080081 May 16 19:08:38.701204 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 23/56] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:08:39.018800 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-41103f4a-7a28-44c4-9bcf-803e2e9284a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:39.027931 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-41103f4a-7a28-44c4-9bcf-803e2e9284a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:39.033917 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-41103f4a-7a28-44c4-9bcf-803e2e9284a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:39.035195 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-41103f4a-7a28-44c4-9bcf-803e2e9284a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.781639 May 16 19:08:39.037844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8d35280d-c1d7-4716-bdf7-cb5d158b65f9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:39.038658 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8d35280d-c1d7-4716-bdf7-cb5d158b65f9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:39.038779 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 34/57] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:38 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:08:39.049343 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8d35280d-c1d7-4716-bdf7-cb5d158b65f9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:39.051599 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8d35280d-c1d7-4716-bdf7-cb5d158b65f9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:39.058217 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8d35280d-c1d7-4716-bdf7-cb5d158b65f9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:39.060276 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8d35280d-c1d7-4716-bdf7-cb5d158b65f9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:39.123092 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-8ee275ff-544e-46ab-aec9-d8c51005338e req-84881221-9a86-4111-a1ed-c52365ab6f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5b53695-b6e7-4e7b-b6d5-539770d20f41", "tag": "5ed69d31-3be1-4fa7-a495-fce15a7677cb"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:39.134365 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-8ee275ff-544e-46ab-aec9-d8c51005338e req-84881221-9a86-4111-a1ed-c52365ab6f34 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:39.139013 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-8ee275ff-544e-46ab-aec9-d8c51005338e req-84881221-9a86-4111-a1ed-c52365ab6f34 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:39.160281 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-8ee275ff-544e-46ab-aec9-d8c51005338e req-84881221-9a86-4111-a1ed-c52365ab6f34 service nova] Creating event network-changed:5ed69d31-3be1-4fa7-a495-fce15a7677cb for instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 on hv-cinder-76606 May 16 19:08:39.172461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-8ee275ff-544e-46ab-aec9-d8c51005338e req-84881221-9a86-4111-a1ed-c52365ab6f34 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054344 May 16 19:08:39.180421 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 35/58] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:08:39.268088 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-38bf8eff-5b07-48d2-81d7-2c7717077b6c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:39.268792 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-38bf8eff-5b07-48d2-81d7-2c7717077b6c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:39.276921 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-38bf8eff-5b07-48d2-81d7-2c7717077b6c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:39.277363 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-38bf8eff-5b07-48d2-81d7-2c7717077b6c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:39.285120 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-38bf8eff-5b07-48d2-81d7-2c7717077b6c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:39.286022 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-38bf8eff-5b07-48d2-81d7-2c7717077b6c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:39.419529 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-38bf8eff-5b07-48d2-81d7-2c7717077b6c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:39.444712 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-38bf8eff-5b07-48d2-81d7-2c7717077b6c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1280 microversion: 2.1 time: 0.181102 May 16 19:08:39.445834 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 36/59] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:39 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1280 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:08:39.453438 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ad6a4a98-e494-4aba-a2c8-a034d5b8fb06 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:39.454278 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ad6a4a98-e494-4aba-a2c8-a034d5b8fb06 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:39.467895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ad6a4a98-e494-4aba-a2c8-a034d5b8fb06 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:39.468916 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ad6a4a98-e494-4aba-a2c8-a034d5b8fb06 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:39.469242 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ad6a4a98-e494-4aba-a2c8-a034d5b8fb06 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:39.469848 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ad6a4a98-e494-4aba-a2c8-a034d5b8fb06 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:39.470312 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-8d35280d-c1d7-4716-bdf7-cb5d158b65f9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:39.479564 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8d35280d-c1d7-4716-bdf7-cb5d158b65f9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1362 microversion: 2.1 time: 0.448322 May 16 19:08:39.482350 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 24/60] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:39 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1362 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:08:39.633930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-58e66380-3e67-4fbf-85cc-19af2bc17c5e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:39.638321 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-58e66380-3e67-4fbf-85cc-19af2bc17c5e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:39.649102 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-58e66380-3e67-4fbf-85cc-19af2bc17c5e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:39.649988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-58e66380-3e67-4fbf-85cc-19af2bc17c5e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:39.652317 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-58e66380-3e67-4fbf-85cc-19af2bc17c5e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:39.652761 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-58e66380-3e67-4fbf-85cc-19af2bc17c5e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:40.007370 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-58e66380-3e67-4fbf-85cc-19af2bc17c5e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:40.015031 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-58e66380-3e67-4fbf-85cc-19af2bc17c5e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 0.386664 May 16 19:08:40.024805 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 25/61] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:39 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:40.077035 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-84a0268f-75a3-4fd4-9c5b-6b64193d8d85 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:40.079122 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-84a0268f-75a3-4fd4-9c5b-6b64193d8d85 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:40.087196 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ad6a4a98-e494-4aba-a2c8-a034d5b8fb06 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:40.089317 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-84a0268f-75a3-4fd4-9c5b-6b64193d8d85 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:40.089985 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-84a0268f-75a3-4fd4-9c5b-6b64193d8d85 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:40.092208 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-84a0268f-75a3-4fd4-9c5b-6b64193d8d85 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:40.093345 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-84a0268f-75a3-4fd4-9c5b-6b64193d8d85 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:40.096069 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ad6a4a98-e494-4aba-a2c8-a034d5b8fb06 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1315 microversion: 2.1 time: 0.648415 May 16 19:08:40.105834 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 37/62] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:39 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:40.376788 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-84a0268f-75a3-4fd4-9c5b-6b64193d8d85 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:40.388690 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-84a0268f-75a3-4fd4-9c5b-6b64193d8d85 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:40.391722 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-84a0268f-75a3-4fd4-9c5b-6b64193d8d85 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:40.393330 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-84a0268f-75a3-4fd4-9c5b-6b64193d8d85 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.341029 May 16 19:08:40.395016 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 26/63] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:40 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:08:40.462622 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-adf711e8-c05b-4b9a-9c7d-5a542403a717 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:40.464077 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-adf711e8-c05b-4b9a-9c7d-5a542403a717 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:40.471346 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-adf711e8-c05b-4b9a-9c7d-5a542403a717 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:40.471798 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-adf711e8-c05b-4b9a-9c7d-5a542403a717 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:40.472630 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-adf711e8-c05b-4b9a-9c7d-5a542403a717 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:40.473063 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-adf711e8-c05b-4b9a-9c7d-5a542403a717 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:40.501716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e5b13216-317d-4572-8013-dc6ccd819ddf tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:40.502791 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e5b13216-317d-4572-8013-dc6ccd819ddf tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:40.513994 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5b13216-317d-4572-8013-dc6ccd819ddf tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:40.514437 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5b13216-317d-4572-8013-dc6ccd819ddf tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:40.515389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5b13216-317d-4572-8013-dc6ccd819ddf tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:40.515968 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5b13216-317d-4572-8013-dc6ccd819ddf tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:40.658903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-adf711e8-c05b-4b9a-9c7d-5a542403a717 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:40.677303 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-adf711e8-c05b-4b9a-9c7d-5a542403a717 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1280 microversion: 2.1 time: 0.215628 May 16 19:08:40.679555 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 38/64] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:40 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1280 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:40.929752 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e5b13216-317d-4572-8013-dc6ccd819ddf tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:40.938652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e5b13216-317d-4572-8013-dc6ccd819ddf tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1362 microversion: 2.1 time: 0.440710 May 16 19:08:40.953039 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 27/65] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:40 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1362 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:41.032546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-02683371-d838-490b-9b9a-efb3ee541830 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:41.033422 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-02683371-d838-490b-9b9a-efb3ee541830 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:41.048755 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-02683371-d838-490b-9b9a-efb3ee541830 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:41.053969 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-02683371-d838-490b-9b9a-efb3ee541830 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:41.055758 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-02683371-d838-490b-9b9a-efb3ee541830 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:41.058814 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-02683371-d838-490b-9b9a-efb3ee541830 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:41.113470 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-921093b9-f4e0-4a61-8975-13f88991ef36 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:41.114139 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-921093b9-f4e0-4a61-8975-13f88991ef36 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:41.131084 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-921093b9-f4e0-4a61-8975-13f88991ef36 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:41.149429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-921093b9-f4e0-4a61-8975-13f88991ef36 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:41.150895 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-921093b9-f4e0-4a61-8975-13f88991ef36 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:41.153025 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-921093b9-f4e0-4a61-8975-13f88991ef36 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:41.716628 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-921093b9-f4e0-4a61-8975-13f88991ef36 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:41.725821 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-921093b9-f4e0-4a61-8975-13f88991ef36 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1315 microversion: 2.1 time: 0.616771 May 16 19:08:41.734479 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 28/66] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:41 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1315 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:41.755307 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-84da6094-c81e-4a11-b720-d249b3dcfb80 req-61bdabc4-ca14-49e1-99c2-ea3280b6e356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ade137-6172-4f24-80ef-9e84b6fb6df7", "tag": "417ef627-ac75-48a8-b654-6f19e3e9c733"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:41.793116 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-84da6094-c81e-4a11-b720-d249b3dcfb80 req-61bdabc4-ca14-49e1-99c2-ea3280b6e356 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:41.794919 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-84da6094-c81e-4a11-b720-d249b3dcfb80 req-61bdabc4-ca14-49e1-99c2-ea3280b6e356 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:41.824413 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-84da6094-c81e-4a11-b720-d249b3dcfb80 req-61bdabc4-ca14-49e1-99c2-ea3280b6e356 service nova] Creating event network-changed:417ef627-ac75-48a8-b654-6f19e3e9c733 for instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 on hv-cinder-76606 May 16 19:08:41.832454 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-84da6094-c81e-4a11-b720-d249b3dcfb80 req-61bdabc4-ca14-49e1-99c2-ea3280b6e356 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094035 May 16 19:08:41.833237 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 29/67] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:08:41.839198 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d6ff9178-4ed6-4c64-ab4b-b7a6c81960d8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:41.840776 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d6ff9178-4ed6-4c64-ab4b-b7a6c81960d8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:41.850897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d6ff9178-4ed6-4c64-ab4b-b7a6c81960d8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:41.851525 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d6ff9178-4ed6-4c64-ab4b-b7a6c81960d8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:41.852478 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d6ff9178-4ed6-4c64-ab4b-b7a6c81960d8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:41.853053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d6ff9178-4ed6-4c64-ab4b-b7a6c81960d8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:42.128317 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-02683371-d838-490b-9b9a-efb3ee541830 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:42.147000 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-02683371-d838-490b-9b9a-efb3ee541830 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 1.118542 May 16 19:08:42.148099 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 39/68] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:41 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:42.412706 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d6ff9178-4ed6-4c64-ab4b-b7a6c81960d8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:42.428091 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d6ff9178-4ed6-4c64-ab4b-b7a6c81960d8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:42.429402 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-c9191538-4ac8-428f-8a1c-1571aaf64c72 req-4d0af60d-3473-4fcc-816c-7cbbe0088b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39fb145-de7f-49c4-ac8f-eacbb6c9a673", "name": "network-vif-plugged", "status": "completed", "tag": "2e11282d-6548-42a2-bd7b-f48e111161b1"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:42.431216 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d6ff9178-4ed6-4c64-ab4b-b7a6c81960d8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:42.434766 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d6ff9178-4ed6-4c64-ab4b-b7a6c81960d8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.600139 May 16 19:08:42.447638 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 30/69] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:41 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:08:42.449456 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-c9191538-4ac8-428f-8a1c-1571aaf64c72 req-4d0af60d-3473-4fcc-816c-7cbbe0088b3d service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:42.450028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-c9191538-4ac8-428f-8a1c-1571aaf64c72 req-4d0af60d-3473-4fcc-816c-7cbbe0088b3d service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:42.453283 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-390a3a4e-78be-465e-94ff-f20c9d267880 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:42.454236 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-390a3a4e-78be-465e-94ff-f20c9d267880 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:42.461005 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-390a3a4e-78be-465e-94ff-f20c9d267880 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:42.461837 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-390a3a4e-78be-465e-94ff-f20c9d267880 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:42.463165 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-390a3a4e-78be-465e-94ff-f20c9d267880 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:42.463795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-390a3a4e-78be-465e-94ff-f20c9d267880 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:42.472478 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-c9191538-4ac8-428f-8a1c-1571aaf64c72 req-4d0af60d-3473-4fcc-816c-7cbbe0088b3d service nova] Creating event network-vif-plugged:2e11282d-6548-42a2-bd7b-f48e111161b1 for instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 on hv-cinder-76606 May 16 19:08:42.487486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-c9191538-4ac8-428f-8a1c-1571aaf64c72 req-4d0af60d-3473-4fcc-816c-7cbbe0088b3d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.338058 May 16 19:08:42.505042 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 40/70] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:08:42.522313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-51d9c86a-80e0-4aca-a9b7-6206875f7936 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:42.524046 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-51d9c86a-80e0-4aca-a9b7-6206875f7936 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:42.550311 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-51d9c86a-80e0-4aca-a9b7-6206875f7936 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:42.550873 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-51d9c86a-80e0-4aca-a9b7-6206875f7936 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:42.551703 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-51d9c86a-80e0-4aca-a9b7-6206875f7936 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:42.552130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-51d9c86a-80e0-4aca-a9b7-6206875f7936 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:42.957701 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-390a3a4e-78be-465e-94ff-f20c9d267880 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:42.965479 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-390a3a4e-78be-465e-94ff-f20c9d267880 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.516378 May 16 19:08:42.968232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 31/71] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:42 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:42.976977 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5de5dfe1-359e-47d3-9a3e-94c1417384bc tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:42.980603 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5de5dfe1-359e-47d3-9a3e-94c1417384bc tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:43.009922 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5de5dfe1-359e-47d3-9a3e-94c1417384bc tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:43.010346 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5de5dfe1-359e-47d3-9a3e-94c1417384bc tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:43.011130 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5de5dfe1-359e-47d3-9a3e-94c1417384bc tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:43.015771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5de5dfe1-359e-47d3-9a3e-94c1417384bc tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:43.033289 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-51d9c86a-80e0-4aca-a9b7-6206875f7936 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:43.041865 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-51d9c86a-80e0-4aca-a9b7-6206875f7936 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1362 microversion: 2.1 time: 0.535397 May 16 19:08:43.042612 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 41/72] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:42 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1362 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:43.171306 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4e23f9dd-014b-431e-9ca8-ee103137e783 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:43.172912 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-4e23f9dd-014b-431e-9ca8-ee103137e783 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:43.190478 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4e23f9dd-014b-431e-9ca8-ee103137e783 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:43.192517 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4e23f9dd-014b-431e-9ca8-ee103137e783 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:43.193703 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4e23f9dd-014b-431e-9ca8-ee103137e783 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:43.194156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4e23f9dd-014b-431e-9ca8-ee103137e783 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:43.404572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-5de5dfe1-359e-47d3-9a3e-94c1417384bc tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:43.422367 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-5de5dfe1-359e-47d3-9a3e-94c1417384bc tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1315 microversion: 2.1 time: 0.452402 May 16 19:08:43.423901 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 32/73] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:42 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:43.454562 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-04506107-624d-4754-b7c4-e26dd9c1230d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:43.455597 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-04506107-624d-4754-b7c4-e26dd9c1230d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:43.463060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-04506107-624d-4754-b7c4-e26dd9c1230d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:43.463801 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-04506107-624d-4754-b7c4-e26dd9c1230d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:43.464856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-04506107-624d-4754-b7c4-e26dd9c1230d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:43.465591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-04506107-624d-4754-b7c4-e26dd9c1230d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:43.532325 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4e23f9dd-014b-431e-9ca8-ee103137e783 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:43.542880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4e23f9dd-014b-431e-9ca8-ee103137e783 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 0.381782 May 16 19:08:43.554143 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 42/74] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:43 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:43.632267 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-c47e0ca4-9d18-497b-82d4-2c86ba543ad5 req-44f1d07b-536a-491f-9e54-d7f0963a15c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6fa5413-e91f-461c-8007-e68d68254d4d", "tag": "d42ccf63-2fe3-4b5d-ac16-147a92271cef"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:43.646320 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-c47e0ca4-9d18-497b-82d4-2c86ba543ad5 req-44f1d07b-536a-491f-9e54-d7f0963a15c6 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:43.646764 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-c47e0ca4-9d18-497b-82d4-2c86ba543ad5 req-44f1d07b-536a-491f-9e54-d7f0963a15c6 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:43.646949 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-04506107-624d-4754-b7c4-e26dd9c1230d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:43.660949 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-04506107-624d-4754-b7c4-e26dd9c1230d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:43.661913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-c47e0ca4-9d18-497b-82d4-2c86ba543ad5 req-44f1d07b-536a-491f-9e54-d7f0963a15c6 service nova] Creating event network-changed:d42ccf63-2fe3-4b5d-ac16-147a92271cef for instance e6fa5413-e91f-461c-8007-e68d68254d4d on hv-cinder-76606 May 16 19:08:43.664177 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-04506107-624d-4754-b7c4-e26dd9c1230d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:43.666639 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-c47e0ca4-9d18-497b-82d4-2c86ba543ad5 req-44f1d07b-536a-491f-9e54-d7f0963a15c6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038179 May 16 19:08:43.667564 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 43/75] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:08:43.668362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-04506107-624d-4754-b7c4-e26dd9c1230d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.218618 May 16 19:08:43.669358 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 33/76] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:43 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:08:43.985129 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-700608b8-a77e-42c9-a13d-4638406d67f3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:43.985880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-700608b8-a77e-42c9-a13d-4638406d67f3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:43.992577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-700608b8-a77e-42c9-a13d-4638406d67f3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:43.993030 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-700608b8-a77e-42c9-a13d-4638406d67f3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:43.993842 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-700608b8-a77e-42c9-a13d-4638406d67f3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:43.994283 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-700608b8-a77e-42c9-a13d-4638406d67f3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:44.058880 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2c17a13d-afd1-4072-b3b7-405eff916c42 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:44.059513 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2c17a13d-afd1-4072-b3b7-405eff916c42 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:44.067138 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c17a13d-afd1-4072-b3b7-405eff916c42 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:44.067602 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c17a13d-afd1-4072-b3b7-405eff916c42 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:44.068380 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c17a13d-afd1-4072-b3b7-405eff916c42 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:44.068813 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c17a13d-afd1-4072-b3b7-405eff916c42 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:44.189603 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-700608b8-a77e-42c9-a13d-4638406d67f3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:44.201424 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-700608b8-a77e-42c9-a13d-4638406d67f3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.216066 May 16 19:08:44.202100 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 44/77] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:43 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:44.234551 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2c17a13d-afd1-4072-b3b7-405eff916c42 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:44.244498 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2c17a13d-afd1-4072-b3b7-405eff916c42 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1362 microversion: 2.1 time: 0.189708 May 16 19:08:44.245074 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 34/78] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:44 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:44.440691 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-472c6d08-1b57-49f8-9e3c-31a7fb2e8ab0 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:44.442402 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-472c6d08-1b57-49f8-9e3c-31a7fb2e8ab0 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:44.449656 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-472c6d08-1b57-49f8-9e3c-31a7fb2e8ab0 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:44.450107 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-472c6d08-1b57-49f8-9e3c-31a7fb2e8ab0 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:44.451467 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-472c6d08-1b57-49f8-9e3c-31a7fb2e8ab0 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:44.453712 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-472c6d08-1b57-49f8-9e3c-31a7fb2e8ab0 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:44.544503 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-0f17e0e4-21e6-4282-9011-0dafe1db9ea2 req-d24e505d-f1aa-413a-a846-eba0387d73e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a68fcd6b-1593-4fd4-8915-3153f52105c1", "name": "network-vif-plugged", "status": "completed", "tag": "f100112e-7e29-4339-bff0-b6f0d938007d"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:44.560528 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-0f17e0e4-21e6-4282-9011-0dafe1db9ea2 req-d24e505d-f1aa-413a-a846-eba0387d73e2 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:44.560964 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-0f17e0e4-21e6-4282-9011-0dafe1db9ea2 req-d24e505d-f1aa-413a-a846-eba0387d73e2 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:44.592554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-0f17e0e4-21e6-4282-9011-0dafe1db9ea2 req-d24e505d-f1aa-413a-a846-eba0387d73e2 service nova] Creating event network-vif-plugged:f100112e-7e29-4339-bff0-b6f0d938007d for instance a68fcd6b-1593-4fd4-8915-3153f52105c1 on hv-cinder-76606 May 16 19:08:44.599356 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-0f17e0e4-21e6-4282-9011-0dafe1db9ea2 req-d24e505d-f1aa-413a-a846-eba0387d73e2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059691 May 16 19:08:44.600651 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 35/79] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:08:44.606707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-413279c8-bbee-4811-836d-4a0bba5ef047 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:44.607484 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-413279c8-bbee-4811-836d-4a0bba5ef047 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:44.628427 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-413279c8-bbee-4811-836d-4a0bba5ef047 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:44.629294 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-413279c8-bbee-4811-836d-4a0bba5ef047 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:44.630664 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-413279c8-bbee-4811-836d-4a0bba5ef047 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:44.631244 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-413279c8-bbee-4811-836d-4a0bba5ef047 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:44.815116 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-472c6d08-1b57-49f8-9e3c-31a7fb2e8ab0 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:44.823504 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-472c6d08-1b57-49f8-9e3c-31a7fb2e8ab0 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1315 microversion: 2.1 time: 0.386881 May 16 19:08:44.824702 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 45/80] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:44 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:44.831070 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-053e1162-1385-42e1-b808-ddf3aee0004b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:44.831691 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-053e1162-1385-42e1-b808-ddf3aee0004b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:44.838717 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-053e1162-1385-42e1-b808-ddf3aee0004b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:44.839242 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-053e1162-1385-42e1-b808-ddf3aee0004b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:44.840423 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-053e1162-1385-42e1-b808-ddf3aee0004b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:44.841295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-053e1162-1385-42e1-b808-ddf3aee0004b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:44.896541 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-413279c8-bbee-4811-836d-4a0bba5ef047 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:44.916491 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-413279c8-bbee-4811-836d-4a0bba5ef047 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 0.314608 May 16 19:08:44.917077 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 36/81] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:44 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:44.992838 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-053e1162-1385-42e1-b808-ddf3aee0004b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:45.001407 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-053e1162-1385-42e1-b808-ddf3aee0004b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:45.002966 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-053e1162-1385-42e1-b808-ddf3aee0004b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:45.004169 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-053e1162-1385-42e1-b808-ddf3aee0004b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.178080 May 16 19:08:45.004747 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 46/82] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:44 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:08:45.220691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-fb78bb9d-89ee-407f-9e8c-63e51d21ba87 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:45.221388 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-fb78bb9d-89ee-407f-9e8c-63e51d21ba87 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:45.227970 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb78bb9d-89ee-407f-9e8c-63e51d21ba87 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:45.228409 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb78bb9d-89ee-407f-9e8c-63e51d21ba87 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:45.229198 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb78bb9d-89ee-407f-9e8c-63e51d21ba87 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:45.229663 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb78bb9d-89ee-407f-9e8c-63e51d21ba87 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:45.261177 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-2519825a-311f-4e22-90f7-66639879f7ab tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:45.261882 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-2519825a-311f-4e22-90f7-66639879f7ab tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:45.268548 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2519825a-311f-4e22-90f7-66639879f7ab tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:45.269296 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2519825a-311f-4e22-90f7-66639879f7ab tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:45.270103 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2519825a-311f-4e22-90f7-66639879f7ab tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:45.270537 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2519825a-311f-4e22-90f7-66639879f7ab tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:45.401001 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-fb78bb9d-89ee-407f-9e8c-63e51d21ba87 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:45.409086 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-fb78bb9d-89ee-407f-9e8c-63e51d21ba87 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.192440 May 16 19:08:45.419061 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 37/83] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:45 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:45.624691 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-2519825a-311f-4e22-90f7-66639879f7ab tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:45.631961 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-2519825a-311f-4e22-90f7-66639879f7ab tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1362 microversion: 2.1 time: 0.375221 May 16 19:08:45.632725 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 47/84] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:45 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1362 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:08:45.840202 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-12736409-b361-46a6-8cb9-b7accb177a08 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:45.840885 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-12736409-b361-46a6-8cb9-b7accb177a08 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:45.846900 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-12736409-b361-46a6-8cb9-b7accb177a08 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:45.847343 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-12736409-b361-46a6-8cb9-b7accb177a08 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:45.848094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-12736409-b361-46a6-8cb9-b7accb177a08 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:45.848567 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-12736409-b361-46a6-8cb9-b7accb177a08 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:45.932578 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-bad40e6a-92a3-49fc-89c7-57aa32007479 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:45.933195 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-bad40e6a-92a3-49fc-89c7-57aa32007479 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:45.943634 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bad40e6a-92a3-49fc-89c7-57aa32007479 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:45.944090 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bad40e6a-92a3-49fc-89c7-57aa32007479 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:45.944880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bad40e6a-92a3-49fc-89c7-57aa32007479 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:45.945322 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bad40e6a-92a3-49fc-89c7-57aa32007479 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:45.985578 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-12736409-b361-46a6-8cb9-b7accb177a08 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:45.993314 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-12736409-b361-46a6-8cb9-b7accb177a08 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1315 microversion: 2.1 time: 0.156936 May 16 19:08:45.994113 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 38/85] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:45 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:46.022350 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4dc11a7a-f6ef-4f82-9031-3ed938e6e04e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:46.022960 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-4dc11a7a-f6ef-4f82-9031-3ed938e6e04e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:46.029266 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4dc11a7a-f6ef-4f82-9031-3ed938e6e04e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:46.029957 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4dc11a7a-f6ef-4f82-9031-3ed938e6e04e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:46.030769 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4dc11a7a-f6ef-4f82-9031-3ed938e6e04e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:46.031193 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4dc11a7a-f6ef-4f82-9031-3ed938e6e04e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:46.079195 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-bad40e6a-92a3-49fc-89c7-57aa32007479 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:46.087712 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-bad40e6a-92a3-49fc-89c7-57aa32007479 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 0.158937 May 16 19:08:46.088587 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 48/86] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:45 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:08:46.162201 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4dc11a7a-f6ef-4f82-9031-3ed938e6e04e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:46.170576 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4dc11a7a-f6ef-4f82-9031-3ed938e6e04e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:46.172159 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4dc11a7a-f6ef-4f82-9031-3ed938e6e04e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:46.173371 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4dc11a7a-f6ef-4f82-9031-3ed938e6e04e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.155139 May 16 19:08:46.174021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 39/87] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:46 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:08:46.426203 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-078d0e21-6ef4-4d48-8abd-0700e77bb737 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:46.426781 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-078d0e21-6ef4-4d48-8abd-0700e77bb737 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:46.432721 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-078d0e21-6ef4-4d48-8abd-0700e77bb737 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:46.433175 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-078d0e21-6ef4-4d48-8abd-0700e77bb737 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:46.433978 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-078d0e21-6ef4-4d48-8abd-0700e77bb737 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:46.434402 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-078d0e21-6ef4-4d48-8abd-0700e77bb737 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:46.563300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-078d0e21-6ef4-4d48-8abd-0700e77bb737 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:46.571329 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-078d0e21-6ef4-4d48-8abd-0700e77bb737 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.149112 May 16 19:08:46.572056 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 49/88] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:46 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:46.625257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-16b3b2ad-e26d-4d3f-a8f2-daca97fc587b req-5ee2a22a-30fe-43c5-8d45-c441fb44a66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc4667a-a2c3-459c-ac05-45720bc0f622", "name": "network-vif-plugged", "status": "completed", "tag": "481f3e6e-6d8b-4a1e-96fe-1213734def9a"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:46.633489 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-16b3b2ad-e26d-4d3f-a8f2-daca97fc587b req-5ee2a22a-30fe-43c5-8d45-c441fb44a66a service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:46.633948 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-16b3b2ad-e26d-4d3f-a8f2-daca97fc587b req-5ee2a22a-30fe-43c5-8d45-c441fb44a66a service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:46.644892 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-16b3b2ad-e26d-4d3f-a8f2-daca97fc587b req-5ee2a22a-30fe-43c5-8d45-c441fb44a66a service nova] Creating event network-vif-plugged:481f3e6e-6d8b-4a1e-96fe-1213734def9a for instance 9cc4667a-a2c3-459c-ac05-45720bc0f622 on hv-cinder-76606 May 16 19:08:46.648253 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-846b8017-3cd8-470f-8f44-0daf9c888130 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:46.648942 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-846b8017-3cd8-470f-8f44-0daf9c888130 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:46.649934 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-16b3b2ad-e26d-4d3f-a8f2-daca97fc587b req-5ee2a22a-30fe-43c5-8d45-c441fb44a66a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028322 May 16 19:08:46.650635 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 40/89] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:08:46.656169 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-846b8017-3cd8-470f-8f44-0daf9c888130 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:46.656624 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-846b8017-3cd8-470f-8f44-0daf9c888130 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:46.657438 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-846b8017-3cd8-470f-8f44-0daf9c888130 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:46.657896 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-846b8017-3cd8-470f-8f44-0daf9c888130 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:46.796554 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-846b8017-3cd8-470f-8f44-0daf9c888130 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:46.804412 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-846b8017-3cd8-470f-8f44-0daf9c888130 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1362 microversion: 2.1 time: 0.160074 May 16 19:08:46.805005 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 50/90] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:46 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:47.015874 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4fc31231-f1b5-49f3-9d0a-f2273c871297 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:47.016995 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-4fc31231-f1b5-49f3-9d0a-f2273c871297 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:47.027581 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4fc31231-f1b5-49f3-9d0a-f2273c871297 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:47.028320 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4fc31231-f1b5-49f3-9d0a-f2273c871297 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:47.030033 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4fc31231-f1b5-49f3-9d0a-f2273c871297 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:47.030743 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4fc31231-f1b5-49f3-9d0a-f2273c871297 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:47.104826 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-40736c39-4262-46fb-9dba-3672297afe78 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:47.105657 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-40736c39-4262-46fb-9dba-3672297afe78 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:47.112017 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-40736c39-4262-46fb-9dba-3672297afe78 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:47.112465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-40736c39-4262-46fb-9dba-3672297afe78 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:47.113292 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-40736c39-4262-46fb-9dba-3672297afe78 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:47.113817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-40736c39-4262-46fb-9dba-3672297afe78 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:47.170291 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4fc31231-f1b5-49f3-9d0a-f2273c871297 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:47.177799 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4fc31231-f1b5-49f3-9d0a-f2273c871297 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1315 microversion: 2.1 time: 0.169111 May 16 19:08:47.178367 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 41/91] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:47 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:47.190670 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-32aeace3-7c21-4e2a-8752-b043457816da tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:47.191271 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-32aeace3-7c21-4e2a-8752-b043457816da tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:47.197922 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-32aeace3-7c21-4e2a-8752-b043457816da tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:47.198367 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-32aeace3-7c21-4e2a-8752-b043457816da tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:47.199133 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-32aeace3-7c21-4e2a-8752-b043457816da tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:47.199609 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-32aeace3-7c21-4e2a-8752-b043457816da tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:47.245722 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-40736c39-4262-46fb-9dba-3672297afe78 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:47.255978 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-40736c39-4262-46fb-9dba-3672297afe78 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 0.154671 May 16 19:08:47.256566 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 51/92] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:47 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:47.336857 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-32aeace3-7c21-4e2a-8752-b043457816da tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:47.346055 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-32aeace3-7c21-4e2a-8752-b043457816da tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:47.347792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-32aeace3-7c21-4e2a-8752-b043457816da tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:47.348692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-32aeace3-7c21-4e2a-8752-b043457816da tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.161879 May 16 19:08:47.349222 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 42/93] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:47 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:08:47.588400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3075377b-165d-45c3-849e-e99618aafd97 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:47.589916 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-3075377b-165d-45c3-849e-e99618aafd97 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:47.598699 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3075377b-165d-45c3-849e-e99618aafd97 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:47.599151 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3075377b-165d-45c3-849e-e99618aafd97 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:47.600354 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3075377b-165d-45c3-849e-e99618aafd97 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:47.601778 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3075377b-165d-45c3-849e-e99618aafd97 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:47.821588 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a80575c5-1d99-46e6-8ee2-530521b38fd7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:47.822390 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a80575c5-1d99-46e6-8ee2-530521b38fd7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:47.828604 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a80575c5-1d99-46e6-8ee2-530521b38fd7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:47.829165 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a80575c5-1d99-46e6-8ee2-530521b38fd7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:47.830023 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a80575c5-1d99-46e6-8ee2-530521b38fd7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:47.830516 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a80575c5-1d99-46e6-8ee2-530521b38fd7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:47.891085 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-3075377b-165d-45c3-849e-e99618aafd97 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:47.900432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-3075377b-165d-45c3-849e-e99618aafd97 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.315900 May 16 19:08:47.901206 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 52/94] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:47 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:47.957978 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a80575c5-1d99-46e6-8ee2-530521b38fd7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:47.965251 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a80575c5-1d99-46e6-8ee2-530521b38fd7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1362 microversion: 2.1 time: 0.147610 May 16 19:08:47.965861 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 43/95] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:47 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:48.194672 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4f0a9eb9-4354-4850-91d9-afbd7efb96df tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:48.195282 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-4f0a9eb9-4354-4850-91d9-afbd7efb96df tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:48.201713 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4f0a9eb9-4354-4850-91d9-afbd7efb96df tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:48.202155 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4f0a9eb9-4354-4850-91d9-afbd7efb96df tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:48.202914 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4f0a9eb9-4354-4850-91d9-afbd7efb96df tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:48.203340 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4f0a9eb9-4354-4850-91d9-afbd7efb96df tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:48.272469 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-1a0a0d2a-ea58-440c-9c4a-8d51789b2991 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:48.272905 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-1a0a0d2a-ea58-440c-9c4a-8d51789b2991 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:48.279691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1a0a0d2a-ea58-440c-9c4a-8d51789b2991 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:48.280399 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1a0a0d2a-ea58-440c-9c4a-8d51789b2991 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:48.281327 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1a0a0d2a-ea58-440c-9c4a-8d51789b2991 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:48.281979 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1a0a0d2a-ea58-440c-9c4a-8d51789b2991 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:48.356965 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4f0a9eb9-4354-4850-91d9-afbd7efb96df tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:48.368920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4f0a9eb9-4354-4850-91d9-afbd7efb96df tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1315 microversion: 2.1 time: 0.177115 May 16 19:08:48.369983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 53/96] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:48 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:48.377973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c7655114-216a-4f7d-9e38-6f8a8e9ebbf0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:48.378523 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c7655114-216a-4f7d-9e38-6f8a8e9ebbf0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:48.385752 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c7655114-216a-4f7d-9e38-6f8a8e9ebbf0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:48.386210 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c7655114-216a-4f7d-9e38-6f8a8e9ebbf0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:48.387072 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c7655114-216a-4f7d-9e38-6f8a8e9ebbf0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:48.387509 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c7655114-216a-4f7d-9e38-6f8a8e9ebbf0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:48.443983 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-1a0a0d2a-ea58-440c-9c4a-8d51789b2991 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:48.453917 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-1a0a0d2a-ea58-440c-9c4a-8d51789b2991 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 0.185354 May 16 19:08:48.454772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 44/97] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:48 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:48.560540 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c7655114-216a-4f7d-9e38-6f8a8e9ebbf0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:48.568911 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c7655114-216a-4f7d-9e38-6f8a8e9ebbf0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:48.570503 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c7655114-216a-4f7d-9e38-6f8a8e9ebbf0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:48.571613 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c7655114-216a-4f7d-9e38-6f8a8e9ebbf0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.200347 May 16 19:08:48.572336 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 54/98] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:48 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:08:48.664491 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-d7310f42-d8e2-4922-bc8a-2e1864c31e32 req-967f4d5f-ca09-4718-927a-eb895180e36b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b53695-b6e7-4e7b-b6d5-539770d20f41", "name": "network-vif-plugged", "status": "completed", "tag": "5ed69d31-3be1-4fa7-a495-fce15a7677cb"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:48.673518 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-d7310f42-d8e2-4922-bc8a-2e1864c31e32 req-967f4d5f-ca09-4718-927a-eb895180e36b service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:48.673991 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-d7310f42-d8e2-4922-bc8a-2e1864c31e32 req-967f4d5f-ca09-4718-927a-eb895180e36b service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:48.685617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-d7310f42-d8e2-4922-bc8a-2e1864c31e32 req-967f4d5f-ca09-4718-927a-eb895180e36b service nova] Creating event network-vif-plugged:5ed69d31-3be1-4fa7-a495-fce15a7677cb for instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 on hv-cinder-76606 May 16 19:08:48.690943 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-d7310f42-d8e2-4922-bc8a-2e1864c31e32 req-967f4d5f-ca09-4718-927a-eb895180e36b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029981 May 16 19:08:48.691545 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 45/99] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:08:48.917095 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0f4097b0-8f1d-4330-aa2c-535f92dee33c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:48.917758 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0f4097b0-8f1d-4330-aa2c-535f92dee33c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:48.924338 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0f4097b0-8f1d-4330-aa2c-535f92dee33c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:48.924783 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0f4097b0-8f1d-4330-aa2c-535f92dee33c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:48.925566 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0f4097b0-8f1d-4330-aa2c-535f92dee33c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:48.926008 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0f4097b0-8f1d-4330-aa2c-535f92dee33c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:48.982701 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-36378a1c-f561-49c6-b553-797e4703a5e4 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:48.983497 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-36378a1c-f561-49c6-b553-797e4703a5e4 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:48.989856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-36378a1c-f561-49c6-b553-797e4703a5e4 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:48.990304 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-36378a1c-f561-49c6-b553-797e4703a5e4 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:48.991071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-36378a1c-f561-49c6-b553-797e4703a5e4 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:48.991472 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-36378a1c-f561-49c6-b553-797e4703a5e4 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:49.128858 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-36378a1c-f561-49c6-b553-797e4703a5e4 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:49.138112 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-36378a1c-f561-49c6-b553-797e4703a5e4 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1362 microversion: 2.1 time: 0.159594 May 16 19:08:49.144859 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 46/100] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:48 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:49.155691 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0f4097b0-8f1d-4330-aa2c-535f92dee33c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:49.163868 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0f4097b0-8f1d-4330-aa2c-535f92dee33c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.250686 May 16 19:08:49.164834 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 55/101] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:48 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:49.386815 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e9acdf10-f6a1-4c14-a1d1-a228db754cff tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:49.387522 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e9acdf10-f6a1-4c14-a1d1-a228db754cff tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:49.393625 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e9acdf10-f6a1-4c14-a1d1-a228db754cff tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:49.394074 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e9acdf10-f6a1-4c14-a1d1-a228db754cff tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:49.394840 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e9acdf10-f6a1-4c14-a1d1-a228db754cff tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:49.395266 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e9acdf10-f6a1-4c14-a1d1-a228db754cff tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:49.472038 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9022bbdf-de85-4fc8-ae4e-7b745fab6ff1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:49.473000 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9022bbdf-de85-4fc8-ae4e-7b745fab6ff1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:49.479268 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9022bbdf-de85-4fc8-ae4e-7b745fab6ff1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:49.479719 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9022bbdf-de85-4fc8-ae4e-7b745fab6ff1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:49.480489 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9022bbdf-de85-4fc8-ae4e-7b745fab6ff1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:49.481887 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9022bbdf-de85-4fc8-ae4e-7b745fab6ff1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:49.528000 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e9acdf10-f6a1-4c14-a1d1-a228db754cff tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:49.536091 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e9acdf10-f6a1-4c14-a1d1-a228db754cff tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1502 microversion: 2.1 time: 0.153385 May 16 19:08:49.536666 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 47/102] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:49 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:08:49.592026 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a0153054-47fc-48b6-b70a-cf3ac982ec1a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:49.593349 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a0153054-47fc-48b6-b70a-cf3ac982ec1a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:49.600706 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a0153054-47fc-48b6-b70a-cf3ac982ec1a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:49.601158 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a0153054-47fc-48b6-b70a-cf3ac982ec1a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:49.602103 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a0153054-47fc-48b6-b70a-cf3ac982ec1a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:49.603159 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a0153054-47fc-48b6-b70a-cf3ac982ec1a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:49.619927 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-9022bbdf-de85-4fc8-ae4e-7b745fab6ff1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:49.631748 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9022bbdf-de85-4fc8-ae4e-7b745fab6ff1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 0.163633 May 16 19:08:49.644550 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 56/103] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:49 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:08:49.760271 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a0153054-47fc-48b6-b70a-cf3ac982ec1a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:49.770262 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a0153054-47fc-48b6-b70a-cf3ac982ec1a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:49.771758 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a0153054-47fc-48b6-b70a-cf3ac982ec1a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:49.772911 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a0153054-47fc-48b6-b70a-cf3ac982ec1a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.186388 May 16 19:08:49.777582 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 48/104] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:49 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:08:50.156127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-820a8c33-cd31-4f1d-b720-95401d1f57b1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:50.156743 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-820a8c33-cd31-4f1d-b720-95401d1f57b1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:50.166510 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-820a8c33-cd31-4f1d-b720-95401d1f57b1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:50.167209 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-820a8c33-cd31-4f1d-b720-95401d1f57b1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:50.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-820a8c33-cd31-4f1d-b720-95401d1f57b1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:50.168957 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-820a8c33-cd31-4f1d-b720-95401d1f57b1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:50.181932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-49c272bd-09f5-421b-ba65-69a02f2c8979 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:50.182538 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-49c272bd-09f5-421b-ba65-69a02f2c8979 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:50.192369 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-49c272bd-09f5-421b-ba65-69a02f2c8979 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:50.192831 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-49c272bd-09f5-421b-ba65-69a02f2c8979 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:50.195543 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-49c272bd-09f5-421b-ba65-69a02f2c8979 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:50.196000 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-49c272bd-09f5-421b-ba65-69a02f2c8979 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:50.325099 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-820a8c33-cd31-4f1d-b720-95401d1f57b1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:50.333859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-820a8c33-cd31-4f1d-b720-95401d1f57b1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1547 microversion: 2.1 time: 0.182878 May 16 19:08:50.334474 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 57/105] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:50 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1547 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:50.350665 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-46febb3d-df3b-41bc-bfe6-3789541a5652 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:50.351156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-46febb3d-df3b-41bc-bfe6-3789541a5652 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:50.357156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-46febb3d-df3b-41bc-bfe6-3789541a5652 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:50.357930 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-46febb3d-df3b-41bc-bfe6-3789541a5652 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:50.358918 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-46febb3d-df3b-41bc-bfe6-3789541a5652 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:50.359812 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-46febb3d-df3b-41bc-bfe6-3789541a5652 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:50.400264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-49c272bd-09f5-421b-ba65-69a02f2c8979 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:50.408075 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-49c272bd-09f5-421b-ba65-69a02f2c8979 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.231543 May 16 19:08:50.408647 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 49/106] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:50 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:08:50.507752 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-46febb3d-df3b-41bc-bfe6-3789541a5652 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160697 May 16 19:08:50.508451 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 58/107] 10.222.0.24 () {58 vars in 1274 bytes} [Mon May 16 19:08:50 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:08:50.650578 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-85d65909-9f72-46e6-b731-72dc0616191b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:50.651450 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-85d65909-9f72-46e6-b731-72dc0616191b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:50.658761 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-85d65909-9f72-46e6-b731-72dc0616191b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:50.658761 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-85d65909-9f72-46e6-b731-72dc0616191b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:50.659502 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-85d65909-9f72-46e6-b731-72dc0616191b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:50.659988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-85d65909-9f72-46e6-b731-72dc0616191b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:50.790201 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e2f52c7d-6894-4825-b6fc-92df2b735258 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:50.790809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e2f52c7d-6894-4825-b6fc-92df2b735258 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:50.798450 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e2f52c7d-6894-4825-b6fc-92df2b735258 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:50.799295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e2f52c7d-6894-4825-b6fc-92df2b735258 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:50.800954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e2f52c7d-6894-4825-b6fc-92df2b735258 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:50.800954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e2f52c7d-6894-4825-b6fc-92df2b735258 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:50.895482 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-85d65909-9f72-46e6-b731-72dc0616191b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:50.902909 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-85d65909-9f72-46e6-b731-72dc0616191b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 0.256305 May 16 19:08:50.904311 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 50/108] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:50 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:50.984359 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e2f52c7d-6894-4825-b6fc-92df2b735258 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:50.998955 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e2f52c7d-6894-4825-b6fc-92df2b735258 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:51.000907 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e2f52c7d-6894-4825-b6fc-92df2b735258 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:51.002813 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e2f52c7d-6894-4825-b6fc-92df2b735258 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.215922 May 16 19:08:51.003354 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 59/109] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:50 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:08:51.034958 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-65437d1a-f8af-433a-8c95-56ea524c012b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "491dc995-79c1-4359-b94f-0b26fe5aa022"}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:51.036441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-65437d1a-f8af-433a-8c95-56ea524c012b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:51.042999 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-65437d1a-f8af-433a-8c95-56ea524c012b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:51.043662 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-65437d1a-f8af-433a-8c95-56ea524c012b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:51.044588 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-65437d1a-f8af-433a-8c95-56ea524c012b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:51.045153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-65437d1a-f8af-433a-8c95-56ea524c012b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:51.425109 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b7083ddc-8f2c-4969-ae76-3dfe36932e61 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:51.426386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b7083ddc-8f2c-4969-ae76-3dfe36932e61 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:51.433160 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b7083ddc-8f2c-4969-ae76-3dfe36932e61 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:51.433658 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b7083ddc-8f2c-4969-ae76-3dfe36932e61 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:51.434592 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b7083ddc-8f2c-4969-ae76-3dfe36932e61 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:51.435163 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b7083ddc-8f2c-4969-ae76-3dfe36932e61 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:51.625275 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b7083ddc-8f2c-4969-ae76-3dfe36932e61 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:51.641710 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b7083ddc-8f2c-4969-ae76-3dfe36932e61 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.220538 May 16 19:08:51.656189 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 60/110] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:51 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:51.921120 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4747498c-cc66-459c-8ff1-014d07ac975f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:51.922123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-4747498c-cc66-459c-8ff1-014d07ac975f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:51.929864 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4747498c-cc66-459c-8ff1-014d07ac975f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:51.930519 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4747498c-cc66-459c-8ff1-014d07ac975f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:51.931486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4747498c-cc66-459c-8ff1-014d07ac975f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:51.932170 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4747498c-cc66-459c-8ff1-014d07ac975f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:52.134615 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4747498c-cc66-459c-8ff1-014d07ac975f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:52.142881 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4747498c-cc66-459c-8ff1-014d07ac975f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 0.226301 May 16 19:08:52.144080 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 61/111] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:51 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:08:52.149019 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c9143049-872c-4739-9326-90acc636a66e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:52.149951 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c9143049-872c-4739-9326-90acc636a66e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:52.156714 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c9143049-872c-4739-9326-90acc636a66e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:52.157470 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c9143049-872c-4739-9326-90acc636a66e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:52.168624 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c9143049-872c-4739-9326-90acc636a66e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:52.169368 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c9143049-872c-4739-9326-90acc636a66e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:52.346517 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c9143049-872c-4739-9326-90acc636a66e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:52.355261 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c9143049-872c-4739-9326-90acc636a66e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:52.357198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c9143049-872c-4739-9326-90acc636a66e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:52.358789 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c9143049-872c-4739-9326-90acc636a66e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.213510 May 16 19:08:52.359840 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 62/112] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:52 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:08:52.365245 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-0e282e03-d1d7-4d56-aa73-bca7ff13eac5 req-65a6a609-49c9-4180-a50b-ef80b2d87900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a68fcd6b-1593-4fd4-8915-3153f52105c1", "tag": "f100112e-7e29-4339-bff0-b6f0d938007d"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:52.374349 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-0e282e03-d1d7-4d56-aa73-bca7ff13eac5 req-65a6a609-49c9-4180-a50b-ef80b2d87900 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:52.375059 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-0e282e03-d1d7-4d56-aa73-bca7ff13eac5 req-65a6a609-49c9-4180-a50b-ef80b2d87900 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:52.388409 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-0e282e03-d1d7-4d56-aa73-bca7ff13eac5 req-65a6a609-49c9-4180-a50b-ef80b2d87900 service nova] Creating event network-changed:f100112e-7e29-4339-bff0-b6f0d938007d for instance a68fcd6b-1593-4fd4-8915-3153f52105c1 on hv-cinder-76606 May 16 19:08:52.394056 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-0e282e03-d1d7-4d56-aa73-bca7ff13eac5 req-65a6a609-49c9-4180-a50b-ef80b2d87900 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032838 May 16 19:08:52.395060 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 63/113] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:08:52.664314 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-301595ae-15ee-4fcc-a57b-67fb09a0e858 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:52.665010 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-301595ae-15ee-4fcc-a57b-67fb09a0e858 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:52.671966 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-301595ae-15ee-4fcc-a57b-67fb09a0e858 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:52.672657 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-301595ae-15ee-4fcc-a57b-67fb09a0e858 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:52.673868 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-301595ae-15ee-4fcc-a57b-67fb09a0e858 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:52.674519 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-301595ae-15ee-4fcc-a57b-67fb09a0e858 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:52.833936 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-301595ae-15ee-4fcc-a57b-67fb09a0e858 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:52.843184 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-301595ae-15ee-4fcc-a57b-67fb09a0e858 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.182984 May 16 19:08:52.843770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 64/114] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:52 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:53.171558 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-a05a03c9-1d57-4f9c-8963-d1bc15a96d78 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:53.172584 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-a05a03c9-1d57-4f9c-8963-d1bc15a96d78 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:53.185812 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a05a03c9-1d57-4f9c-8963-d1bc15a96d78 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:53.187348 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a05a03c9-1d57-4f9c-8963-d1bc15a96d78 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:53.188458 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a05a03c9-1d57-4f9c-8963-d1bc15a96d78 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:53.191052 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a05a03c9-1d57-4f9c-8963-d1bc15a96d78 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:53.409725 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-a05a03c9-1d57-4f9c-8963-d1bc15a96d78 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:53.417921 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-a05a03c9-1d57-4f9c-8963-d1bc15a96d78 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 0.260950 May 16 19:08:53.418871 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 65/115] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:53 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:08:53.424149 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-7566843a-332b-474f-914c-3b2cf34776f6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:53.425047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-7566843a-332b-474f-914c-3b2cf34776f6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:53.432033 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7566843a-332b-474f-914c-3b2cf34776f6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:53.433064 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7566843a-332b-474f-914c-3b2cf34776f6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:53.434355 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7566843a-332b-474f-914c-3b2cf34776f6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:53.434995 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7566843a-332b-474f-914c-3b2cf34776f6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:53.579523 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-7566843a-332b-474f-914c-3b2cf34776f6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:53.587535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-7566843a-332b-474f-914c-3b2cf34776f6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:53.589477 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-7566843a-332b-474f-914c-3b2cf34776f6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:53.597843 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-7566843a-332b-474f-914c-3b2cf34776f6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.177696 May 16 19:08:53.598649 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 66/116] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:53 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:08:53.862213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-fed8a872-2580-427a-909f-e1f230dc9299 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:53.862899 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-fed8a872-2580-427a-909f-e1f230dc9299 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:53.871441 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fed8a872-2580-427a-909f-e1f230dc9299 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:53.871893 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fed8a872-2580-427a-909f-e1f230dc9299 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:53.872668 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fed8a872-2580-427a-909f-e1f230dc9299 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:53.873093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fed8a872-2580-427a-909f-e1f230dc9299 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:54.012580 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-fed8a872-2580-427a-909f-e1f230dc9299 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:54.020480 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-fed8a872-2580-427a-909f-e1f230dc9299 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.163469 May 16 19:08:54.021052 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 67/117] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:53 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:54.434999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-effd3eb2-f98d-4c76-88dc-39a924da4122 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:54.435607 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-effd3eb2-f98d-4c76-88dc-39a924da4122 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:54.442020 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-effd3eb2-f98d-4c76-88dc-39a924da4122 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:54.442474 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-effd3eb2-f98d-4c76-88dc-39a924da4122 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:54.443240 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-effd3eb2-f98d-4c76-88dc-39a924da4122 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:54.443672 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-effd3eb2-f98d-4c76-88dc-39a924da4122 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:54.572448 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-effd3eb2-f98d-4c76-88dc-39a924da4122 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:54.580051 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-effd3eb2-f98d-4c76-88dc-39a924da4122 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 0.148909 May 16 19:08:54.580734 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 68/118] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:54 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:54.616617 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-a3b17bec-42e9-4dce-b6a3-65659bc99f36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:54.617635 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-a3b17bec-42e9-4dce-b6a3-65659bc99f36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:54.623792 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a3b17bec-42e9-4dce-b6a3-65659bc99f36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:54.624237 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a3b17bec-42e9-4dce-b6a3-65659bc99f36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:54.624998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a3b17bec-42e9-4dce-b6a3-65659bc99f36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:54.625430 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a3b17bec-42e9-4dce-b6a3-65659bc99f36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:54.758463 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-a3b17bec-42e9-4dce-b6a3-65659bc99f36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:54.766430 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-a3b17bec-42e9-4dce-b6a3-65659bc99f36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:54.767931 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-a3b17bec-42e9-4dce-b6a3-65659bc99f36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:54.769035 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-a3b17bec-42e9-4dce-b6a3-65659bc99f36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.156926 May 16 19:08:54.769617 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 69/119] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:54 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:08:55.037233 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-077f68d0-c6ec-4b2a-9e7a-dafebb5af00d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:55.037885 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-077f68d0-c6ec-4b2a-9e7a-dafebb5af00d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:55.044282 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-077f68d0-c6ec-4b2a-9e7a-dafebb5af00d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:55.044726 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-077f68d0-c6ec-4b2a-9e7a-dafebb5af00d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:55.045487 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-077f68d0-c6ec-4b2a-9e7a-dafebb5af00d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:55.045928 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-077f68d0-c6ec-4b2a-9e7a-dafebb5af00d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:55.205582 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-077f68d0-c6ec-4b2a-9e7a-dafebb5af00d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:55.214941 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-077f68d0-c6ec-4b2a-9e7a-dafebb5af00d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.181554 May 16 19:08:55.215518 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 70/120] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:55 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:08:55.599115 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5d9e47ca-f30f-4726-a1d1-f266a10578c7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:55.599758 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5d9e47ca-f30f-4726-a1d1-f266a10578c7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:55.606988 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d9e47ca-f30f-4726-a1d1-f266a10578c7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:55.607630 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d9e47ca-f30f-4726-a1d1-f266a10578c7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:55.608373 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d9e47ca-f30f-4726-a1d1-f266a10578c7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:55.608971 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d9e47ca-f30f-4726-a1d1-f266a10578c7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:55.744728 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5d9e47ca-f30f-4726-a1d1-f266a10578c7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:55.752545 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5d9e47ca-f30f-4726-a1d1-f266a10578c7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 0.157397 May 16 19:08:55.753212 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 71/121] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:55 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:55.788293 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3d308a00-4e98-40f8-b54d-98c336bc5b0a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:55.788901 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-3d308a00-4e98-40f8-b54d-98c336bc5b0a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:55.796000 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3d308a00-4e98-40f8-b54d-98c336bc5b0a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:55.796461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3d308a00-4e98-40f8-b54d-98c336bc5b0a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:55.797229 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3d308a00-4e98-40f8-b54d-98c336bc5b0a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:55.797680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3d308a00-4e98-40f8-b54d-98c336bc5b0a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:56.022446 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-65437d1a-f8af-433a-8c95-56ea524c012b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "POST /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.989857 May 16 19:08:56.024257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 51/122] 10.222.0.24 () {60 vars in 1322 bytes} [Mon May 16 19:08:51 2022] POST /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673/os-volume_attachments => generated 194 bytes in 4994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:08:56.121779 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-3d308a00-4e98-40f8-b54d-98c336bc5b0a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:56.130067 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-3d308a00-4e98-40f8-b54d-98c336bc5b0a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:56.131507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-3d308a00-4e98-40f8-b54d-98c336bc5b0a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:56.132687 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-3d308a00-4e98-40f8-b54d-98c336bc5b0a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.350128 May 16 19:08:56.133339 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 72/123] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:55 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:08:56.232500 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-dc5bd395-9b26-40bc-9f65-48d573d666dc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:56.233460 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-dc5bd395-9b26-40bc-9f65-48d573d666dc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:56.241038 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dc5bd395-9b26-40bc-9f65-48d573d666dc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:56.241711 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dc5bd395-9b26-40bc-9f65-48d573d666dc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:56.244211 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dc5bd395-9b26-40bc-9f65-48d573d666dc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:56.244823 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dc5bd395-9b26-40bc-9f65-48d573d666dc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:56.417122 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-dc5bd395-9b26-40bc-9f65-48d573d666dc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:56.425160 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-dc5bd395-9b26-40bc-9f65-48d573d666dc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.197419 May 16 19:08:56.425782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 52/124] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:56 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:56.494800 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-8c236762-fd8f-4121-8da1-105f656aeb7d req-5559e57f-7b84-4146-9cee-3ecd6d615227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ade137-6172-4f24-80ef-9e84b6fb6df7", "name": "network-vif-plugged", "status": "completed", "tag": "417ef627-ac75-48a8-b654-6f19e3e9c733"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:08:56.510031 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-8c236762-fd8f-4121-8da1-105f656aeb7d req-5559e57f-7b84-4146-9cee-3ecd6d615227 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:56.510785 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-8c236762-fd8f-4121-8da1-105f656aeb7d req-5559e57f-7b84-4146-9cee-3ecd6d615227 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:56.528560 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-8c236762-fd8f-4121-8da1-105f656aeb7d req-5559e57f-7b84-4146-9cee-3ecd6d615227 service nova] Creating event network-vif-plugged:417ef627-ac75-48a8-b654-6f19e3e9c733 for instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 on hv-cinder-76606 May 16 19:08:56.538890 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-8c236762-fd8f-4121-8da1-105f656aeb7d req-5559e57f-7b84-4146-9cee-3ecd6d615227 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051436 May 16 19:08:56.540510 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 73/125] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:08:56.769345 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-fe107add-374a-4944-8106-463f186c2118 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:56.769987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-fe107add-374a-4944-8106-463f186c2118 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:56.776541 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fe107add-374a-4944-8106-463f186c2118 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:56.776828 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fe107add-374a-4944-8106-463f186c2118 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:56.778040 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fe107add-374a-4944-8106-463f186c2118 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:56.778477 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fe107add-374a-4944-8106-463f186c2118 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:56.925504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-fe107add-374a-4944-8106-463f186c2118 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:56.933620 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-fe107add-374a-4944-8106-463f186c2118 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 0.167943 May 16 19:08:56.934123 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 53/126] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:56 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:57.151519 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-974fb588-1530-40b3-8293-733c8d80666f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:57.152303 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-974fb588-1530-40b3-8293-733c8d80666f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:57.159123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-974fb588-1530-40b3-8293-733c8d80666f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:57.159576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-974fb588-1530-40b3-8293-733c8d80666f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:57.160362 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-974fb588-1530-40b3-8293-733c8d80666f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:57.160797 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-974fb588-1530-40b3-8293-733c8d80666f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:57.308324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-974fb588-1530-40b3-8293-733c8d80666f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:57.322333 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-974fb588-1530-40b3-8293-733c8d80666f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:57.323849 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-974fb588-1530-40b3-8293-733c8d80666f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:57.326330 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-974fb588-1530-40b3-8293-733c8d80666f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.179053 May 16 19:08:57.326898 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 74/127] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:57 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:08:57.441117 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5ca1aeeb-13d8-4f37-9b67-9c6e138f8ca1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:57.441964 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5ca1aeeb-13d8-4f37-9b67-9c6e138f8ca1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:57.449141 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5ca1aeeb-13d8-4f37-9b67-9c6e138f8ca1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:57.449817 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5ca1aeeb-13d8-4f37-9b67-9c6e138f8ca1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:57.450603 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5ca1aeeb-13d8-4f37-9b67-9c6e138f8ca1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:57.451038 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5ca1aeeb-13d8-4f37-9b67-9c6e138f8ca1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:57.591063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-5ca1aeeb-13d8-4f37-9b67-9c6e138f8ca1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:57.603257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-5ca1aeeb-13d8-4f37-9b67-9c6e138f8ca1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.165954 May 16 19:08:57.603870 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 54/128] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:57 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:57.950354 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5190a411-e468-4917-bbcd-8da6ba759130 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:57.951168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5190a411-e468-4917-bbcd-8da6ba759130 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:57.957438 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5190a411-e468-4917-bbcd-8da6ba759130 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:57.958076 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5190a411-e468-4917-bbcd-8da6ba759130 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:57.958981 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5190a411-e468-4917-bbcd-8da6ba759130 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:57.959548 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5190a411-e468-4917-bbcd-8da6ba759130 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:58.130468 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5190a411-e468-4917-bbcd-8da6ba759130 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:58.138751 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5190a411-e468-4917-bbcd-8da6ba759130 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 0.192183 May 16 19:08:58.139880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 75/129] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:57 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:58.347844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-dc46a20b-0d14-41c1-88c2-8d72718dc872 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:58.349270 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-dc46a20b-0d14-41c1-88c2-8d72718dc872 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:58.357895 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dc46a20b-0d14-41c1-88c2-8d72718dc872 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:58.359057 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dc46a20b-0d14-41c1-88c2-8d72718dc872 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:58.361116 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dc46a20b-0d14-41c1-88c2-8d72718dc872 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:58.362591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dc46a20b-0d14-41c1-88c2-8d72718dc872 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:58.512960 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-dc46a20b-0d14-41c1-88c2-8d72718dc872 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:58.523713 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-dc46a20b-0d14-41c1-88c2-8d72718dc872 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:58.525414 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-dc46a20b-0d14-41c1-88c2-8d72718dc872 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:58.526770 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-dc46a20b-0d14-41c1-88c2-8d72718dc872 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1408 microversion: 2.20 time: 0.185044 May 16 19:08:58.527370 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 55/130] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:58 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:08:58.622384 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-becf6b7c-c653-4b47-aca7-26a5d7d71461 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:58.623001 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-becf6b7c-c653-4b47-aca7-26a5d7d71461 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:58.629205 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-becf6b7c-c653-4b47-aca7-26a5d7d71461 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:58.629702 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-becf6b7c-c653-4b47-aca7-26a5d7d71461 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:58.630474 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-becf6b7c-c653-4b47-aca7-26a5d7d71461 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:58.630906 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-becf6b7c-c653-4b47-aca7-26a5d7d71461 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:58.775093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-becf6b7c-c653-4b47-aca7-26a5d7d71461 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:58.785088 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-becf6b7c-c653-4b47-aca7-26a5d7d71461 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.168164 May 16 19:08:58.785843 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 76/131] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:58 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:59.156275 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ad219b12-b49d-4132-b96d-168336e117ae tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:59.156983 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ad219b12-b49d-4132-b96d-168336e117ae tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:59.163546 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ad219b12-b49d-4132-b96d-168336e117ae tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:59.164208 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ad219b12-b49d-4132-b96d-168336e117ae tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:59.165016 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ad219b12-b49d-4132-b96d-168336e117ae tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:59.165448 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ad219b12-b49d-4132-b96d-168336e117ae tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:59.313612 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ad219b12-b49d-4132-b96d-168336e117ae tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:59.322650 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ad219b12-b49d-4132-b96d-168336e117ae tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 0.170963 May 16 19:08:59.323632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 56/132] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:59 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:08:59.548156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d7653446-f97d-43c8-9d8e-ff6087c5173a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:59.548986 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d7653446-f97d-43c8-9d8e-ff6087c5173a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:59.557850 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d7653446-f97d-43c8-9d8e-ff6087c5173a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:59.559022 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d7653446-f97d-43c8-9d8e-ff6087c5173a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:59.562020 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d7653446-f97d-43c8-9d8e-ff6087c5173a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:59.563013 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d7653446-f97d-43c8-9d8e-ff6087c5173a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:59.752704 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d7653446-f97d-43c8-9d8e-ff6087c5173a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:59.760684 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d7653446-f97d-43c8-9d8e-ff6087c5173a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:59.762345 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d7653446-f97d-43c8-9d8e-ff6087c5173a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:59.763494 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d7653446-f97d-43c8-9d8e-ff6087c5173a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1599 microversion: 2.20 time: 0.222108 May 16 19:08:59.764048 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 77/133] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:08:59 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:08:59.786493 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-aa64c592-123e-46fa-870a-0eecb47fa02c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:59.787222 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-aa64c592-123e-46fa-870a-0eecb47fa02c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:59.793693 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-aa64c592-123e-46fa-870a-0eecb47fa02c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:59.794132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-aa64c592-123e-46fa-870a-0eecb47fa02c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:59.794894 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-aa64c592-123e-46fa-870a-0eecb47fa02c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:59.795308 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-aa64c592-123e-46fa-870a-0eecb47fa02c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:59.803337 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-612b8f3b-91ac-4934-ac97-e084a7978f93 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:08:59.804055 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-612b8f3b-91ac-4934-ac97-e084a7978f93 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:08:59.810916 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-612b8f3b-91ac-4934-ac97-e084a7978f93 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:59.811104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-612b8f3b-91ac-4934-ac97-e084a7978f93 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:59.811979 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-612b8f3b-91ac-4934-ac97-e084a7978f93 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:08:59.812608 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-612b8f3b-91ac-4934-ac97-e084a7978f93 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:08:59.874943 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-aa64c592-123e-46fa-870a-0eecb47fa02c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092387 May 16 19:08:59.875826 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 57/134] 10.222.0.24 () {60 vars in 1315 bytes} [Mon May 16 19:08:59 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 19:08:59.962387 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-612b8f3b-91ac-4934-ac97-e084a7978f93 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:08:59.971773 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-612b8f3b-91ac-4934-ac97-e084a7978f93 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.172851 May 16 19:08:59.973678 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 78/135] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:08:59 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:09:00.350170 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8861d7ac-2772-4bb8-8058-29f4e8bb266e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:00.352218 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8861d7ac-2772-4bb8-8058-29f4e8bb266e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:00.383571 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8861d7ac-2772-4bb8-8058-29f4e8bb266e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:00.386650 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8861d7ac-2772-4bb8-8058-29f4e8bb266e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:00.387822 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8861d7ac-2772-4bb8-8058-29f4e8bb266e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:00.391045 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8861d7ac-2772-4bb8-8058-29f4e8bb266e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:00.461169 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-1b2495d7-64e4-48a5-8847-e45aa5fe1c4e req-cbdacc8e-9a42-4d9f-96fc-63e9e12fdebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6fa5413-e91f-461c-8007-e68d68254d4d", "name": "network-vif-plugged", "status": "completed", "tag": "d42ccf63-2fe3-4b5d-ac16-147a92271cef"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:00.475468 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-1b2495d7-64e4-48a5-8847-e45aa5fe1c4e req-cbdacc8e-9a42-4d9f-96fc-63e9e12fdebc service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:00.476223 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-1b2495d7-64e4-48a5-8847-e45aa5fe1c4e req-cbdacc8e-9a42-4d9f-96fc-63e9e12fdebc service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:00.488540 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-1b2495d7-64e4-48a5-8847-e45aa5fe1c4e req-cbdacc8e-9a42-4d9f-96fc-63e9e12fdebc service nova] Creating event network-vif-plugged:d42ccf63-2fe3-4b5d-ac16-147a92271cef for instance e6fa5413-e91f-461c-8007-e68d68254d4d on hv-cinder-76606 May 16 19:09:00.493771 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-1b2495d7-64e4-48a5-8847-e45aa5fe1c4e req-cbdacc8e-9a42-4d9f-96fc-63e9e12fdebc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036968 May 16 19:09:00.494607 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 79/136] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:09:00.868626 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-8861d7ac-2772-4bb8-8058-29f4e8bb266e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:00.876289 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8861d7ac-2772-4bb8-8058-29f4e8bb266e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1367 microversion: 2.1 time: 0.540124 May 16 19:09:00.876938 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 58/137] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:00 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1367 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:01.015606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-948b2abe-4449-4d25-a9db-6a4e3c8c7955 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:01.018898 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-948b2abe-4449-4d25-a9db-6a4e3c8c7955 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:01.039440 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-948b2abe-4449-4d25-a9db-6a4e3c8c7955 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:01.041078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-948b2abe-4449-4d25-a9db-6a4e3c8c7955 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:01.042538 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-948b2abe-4449-4d25-a9db-6a4e3c8c7955 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:01.044476 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-948b2abe-4449-4d25-a9db-6a4e3c8c7955 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:01.230125 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-948b2abe-4449-4d25-a9db-6a4e3c8c7955 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:01.240359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-cb1a7c0f-a4dd-4f09-967d-e04a5b478548 req-c2870952-9658-48e4-b867-de4686e9e8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5b53695-b6e7-4e7b-b6d5-539770d20f41", "tag": "5ed69d31-3be1-4fa7-a495-fce15a7677cb"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:01.240798 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-948b2abe-4449-4d25-a9db-6a4e3c8c7955 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.255212 May 16 19:09:01.243927 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 80/138] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:00 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:01.249606 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-cb1a7c0f-a4dd-4f09-967d-e04a5b478548 req-c2870952-9658-48e4-b867-de4686e9e8d9 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:01.250260 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-cb1a7c0f-a4dd-4f09-967d-e04a5b478548 req-c2870952-9658-48e4-b867-de4686e9e8d9 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:01.262474 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-cb1a7c0f-a4dd-4f09-967d-e04a5b478548 req-c2870952-9658-48e4-b867-de4686e9e8d9 service nova] Creating event network-changed:5ed69d31-3be1-4fa7-a495-fce15a7677cb for instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 on hv-cinder-76606 May 16 19:09:01.267568 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-cb1a7c0f-a4dd-4f09-967d-e04a5b478548 req-c2870952-9658-48e4-b867-de4686e9e8d9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031222 May 16 19:09:01.268301 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 59/139] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:09:01.894866 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-478301fc-05c8-4cd7-ae51-f0106bfc015d tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:01.895503 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-478301fc-05c8-4cd7-ae51-f0106bfc015d tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:01.902002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-478301fc-05c8-4cd7-ae51-f0106bfc015d tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:01.902002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-478301fc-05c8-4cd7-ae51-f0106bfc015d tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:01.902733 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-478301fc-05c8-4cd7-ae51-f0106bfc015d tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:01.903158 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-478301fc-05c8-4cd7-ae51-f0106bfc015d tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:02.236172 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-478301fc-05c8-4cd7-ae51-f0106bfc015d tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:02.251154 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-478301fc-05c8-4cd7-ae51-f0106bfc015d tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1556 microversion: 2.1 time: 0.360093 May 16 19:09:02.251967 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 81/140] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:01 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1556 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:02.270616 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-45b3cd68-7d88-4ec6-80b2-c5c94ab8a717 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:02.271420 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-45b3cd68-7d88-4ec6-80b2-c5c94ab8a717 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:02.271679 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-a52cbb82-f0bd-4380-a72f-e14ae8c3cf5b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:02.272093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-a52cbb82-f0bd-4380-a72f-e14ae8c3cf5b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:02.280848 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a52cbb82-f0bd-4380-a72f-e14ae8c3cf5b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:02.282265 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a52cbb82-f0bd-4380-a72f-e14ae8c3cf5b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:02.283300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a52cbb82-f0bd-4380-a72f-e14ae8c3cf5b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:02.284019 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a52cbb82-f0bd-4380-a72f-e14ae8c3cf5b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:02.285230 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-45b3cd68-7d88-4ec6-80b2-c5c94ab8a717 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:02.285813 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-45b3cd68-7d88-4ec6-80b2-c5c94ab8a717 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:02.286642 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-45b3cd68-7d88-4ec6-80b2-c5c94ab8a717 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:02.287077 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-45b3cd68-7d88-4ec6-80b2-c5c94ab8a717 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:02.429298 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-a52cbb82-f0bd-4380-a72f-e14ae8c3cf5b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163079 May 16 19:09:02.430492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 82/141] 10.222.0.24 () {58 vars in 1274 bytes} [Mon May 16 19:09:02 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:09:02.507122 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-45b3cd68-7d88-4ec6-80b2-c5c94ab8a717 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:02.515113 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-45b3cd68-7d88-4ec6-80b2-c5c94ab8a717 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.249778 May 16 19:09:02.516748 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 60/142] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:02 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:03.536160 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c5c8be1f-86e3-479f-afc6-5e9465fe9ec7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:03.537142 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c5c8be1f-86e3-479f-afc6-5e9465fe9ec7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:03.543874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c5c8be1f-86e3-479f-afc6-5e9465fe9ec7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:03.544314 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c5c8be1f-86e3-479f-afc6-5e9465fe9ec7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:03.545079 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c5c8be1f-86e3-479f-afc6-5e9465fe9ec7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:03.545506 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c5c8be1f-86e3-479f-afc6-5e9465fe9ec7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:03.744785 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c5c8be1f-86e3-479f-afc6-5e9465fe9ec7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:03.752236 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c5c8be1f-86e3-479f-afc6-5e9465fe9ec7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.220505 May 16 19:09:03.752807 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 83/143] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:03 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:03.919084 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-2fe0ab8f-96d6-4d31-82c4-d26bc21c728c req-525d4e83-c741-4484-8c20-8ffb8f6b9e8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ade137-6172-4f24-80ef-9e84b6fb6df7", "tag": "417ef627-ac75-48a8-b654-6f19e3e9c733"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:03.935030 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-2fe0ab8f-96d6-4d31-82c4-d26bc21c728c req-525d4e83-c741-4484-8c20-8ffb8f6b9e8d service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:03.935661 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-2fe0ab8f-96d6-4d31-82c4-d26bc21c728c req-525d4e83-c741-4484-8c20-8ffb8f6b9e8d service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:03.947692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-2fe0ab8f-96d6-4d31-82c4-d26bc21c728c req-525d4e83-c741-4484-8c20-8ffb8f6b9e8d service nova] Creating event network-changed:417ef627-ac75-48a8-b654-6f19e3e9c733 for instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 on hv-cinder-76606 May 16 19:09:03.953423 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-2fe0ab8f-96d6-4d31-82c4-d26bc21c728c req-525d4e83-c741-4484-8c20-8ffb8f6b9e8d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039488 May 16 19:09:03.954301 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 61/144] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:09:04.769922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8eed670f-1c3b-4664-ab08-668e854f4263 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:04.771078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8eed670f-1c3b-4664-ab08-668e854f4263 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:04.783242 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8eed670f-1c3b-4664-ab08-668e854f4263 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:04.784295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8eed670f-1c3b-4664-ab08-668e854f4263 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:04.785137 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8eed670f-1c3b-4664-ab08-668e854f4263 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:04.785804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8eed670f-1c3b-4664-ab08-668e854f4263 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:04.932533 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8eed670f-1c3b-4664-ab08-668e854f4263 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:04.943312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8eed670f-1c3b-4664-ab08-668e854f4263 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.176324 May 16 19:09:04.949933 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 84/145] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:04 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:05.969791 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e7688a97-332a-4503-a394-dd1a7718be97 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:05.970617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e7688a97-332a-4503-a394-dd1a7718be97 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:05.980562 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e7688a97-332a-4503-a394-dd1a7718be97 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:05.981159 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e7688a97-332a-4503-a394-dd1a7718be97 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:05.982007 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e7688a97-332a-4503-a394-dd1a7718be97 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:05.982562 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e7688a97-332a-4503-a394-dd1a7718be97 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:06.125415 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e7688a97-332a-4503-a394-dd1a7718be97 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:06.134284 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e7688a97-332a-4503-a394-dd1a7718be97 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.177636 May 16 19:09:06.134905 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 62/146] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:05 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:07.151925 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e877c22d-d70a-4075-ae1e-46ee34a6d29f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:07.152678 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e877c22d-d70a-4075-ae1e-46ee34a6d29f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:07.159367 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e877c22d-d70a-4075-ae1e-46ee34a6d29f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:07.159815 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e877c22d-d70a-4075-ae1e-46ee34a6d29f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:07.160549 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e877c22d-d70a-4075-ae1e-46ee34a6d29f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:07.161187 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e877c22d-d70a-4075-ae1e-46ee34a6d29f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:07.288427 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e877c22d-d70a-4075-ae1e-46ee34a6d29f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:07.296340 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e877c22d-d70a-4075-ae1e-46ee34a6d29f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.148790 May 16 19:09:07.296921 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 85/147] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:07 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:08.313164 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7758e32c-5ca6-40ac-a45e-b55f925820cd tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:08.313941 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7758e32c-5ca6-40ac-a45e-b55f925820cd tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:08.320608 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7758e32c-5ca6-40ac-a45e-b55f925820cd tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:08.321055 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7758e32c-5ca6-40ac-a45e-b55f925820cd tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:08.321945 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7758e32c-5ca6-40ac-a45e-b55f925820cd tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:08.322386 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7758e32c-5ca6-40ac-a45e-b55f925820cd tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:08.455098 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7758e32c-5ca6-40ac-a45e-b55f925820cd tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:08.464459 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7758e32c-5ca6-40ac-a45e-b55f925820cd tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.155458 May 16 19:09:08.465165 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 63/148] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:08 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:09.484513 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f721753b-701b-44eb-9dab-f789f5ba4c7a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:09.485050 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f721753b-701b-44eb-9dab-f789f5ba4c7a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:09.491493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f721753b-701b-44eb-9dab-f789f5ba4c7a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:09.491937 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f721753b-701b-44eb-9dab-f789f5ba4c7a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:09.492688 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f721753b-701b-44eb-9dab-f789f5ba4c7a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:09.493117 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f721753b-701b-44eb-9dab-f789f5ba4c7a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:09.622815 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f721753b-701b-44eb-9dab-f789f5ba4c7a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:09.630391 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f721753b-701b-44eb-9dab-f789f5ba4c7a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.150974 May 16 19:09:09.630995 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 86/149] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:09 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:10.652337 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f6398d39-28f9-460d-a086-8c52031f37ca tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:10.653146 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f6398d39-28f9-460d-a086-8c52031f37ca tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:10.660696 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f6398d39-28f9-460d-a086-8c52031f37ca tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:10.661154 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f6398d39-28f9-460d-a086-8c52031f37ca tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:10.661959 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f6398d39-28f9-460d-a086-8c52031f37ca tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:10.662386 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f6398d39-28f9-460d-a086-8c52031f37ca tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:10.808676 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f6398d39-28f9-460d-a086-8c52031f37ca tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:10.817288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f6398d39-28f9-460d-a086-8c52031f37ca tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.171632 May 16 19:09:10.818149 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 64/150] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:10 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:11.835671 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-79860cd7-c91b-42d0-8400-bb30d90ea834 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:11.836264 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-79860cd7-c91b-42d0-8400-bb30d90ea834 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:11.842849 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-79860cd7-c91b-42d0-8400-bb30d90ea834 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:11.843307 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-79860cd7-c91b-42d0-8400-bb30d90ea834 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:11.844143 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-79860cd7-c91b-42d0-8400-bb30d90ea834 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:11.844640 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-79860cd7-c91b-42d0-8400-bb30d90ea834 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:11.978207 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-79860cd7-c91b-42d0-8400-bb30d90ea834 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:11.986166 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-79860cd7-c91b-42d0-8400-bb30d90ea834 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1322 microversion: 2.1 time: 0.154468 May 16 19:09:11.986779 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 87/151] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:11 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:12.480056 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-632d74ed-9225-4602-bb74-1bc6fc014727 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-764512621", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452", "networks": [{"uuid": "59ff3965-e68d-4359-9120-68276006b27c"}]}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:12.534274 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.network.neutron [None req-632d74ed-9225-4602-bb74-1bc6fc014727 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] validate_networks() for [('59ff3965-e68d-4359-9120-68276006b27c', None, None, None, None, None)] {{(pid=117274) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:09:12.910212 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-632d74ed-9225-4602-bb74-1bc6fc014727 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Flavor limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:09:12.910603 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-632d74ed-9225-4602-bb74-1bc6fc014727 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Image limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:09:12.911315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-632d74ed-9225-4602-bb74-1bc6fc014727 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Flavor pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:09:12.911715 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-632d74ed-9225-4602-bb74-1bc6fc014727 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Image pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:09:12.912118 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-632d74ed-9225-4602-bb74-1bc6fc014727 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:09:12.921576 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-632d74ed-9225-4602-bb74-1bc6fc014727 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:12.922034 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-632d74ed-9225-4602-bb74-1bc6fc014727 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:12.922825 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-632d74ed-9225-4602-bb74-1bc6fc014727 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:12.923255 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-632d74ed-9225-4602-bb74-1bc6fc014727 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:12.939874 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-632d74ed-9225-4602-bb74-1bc6fc014727 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Getting quotas for project f7b9188e991a4a7bb57c8a5beb3fb278. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:09:12.943886 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-632d74ed-9225-4602-bb74-1bc6fc014727 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Getting quotas for user c8ac79259d304d589aa1e529849bfcbe and project f7b9188e991a4a7bb57c8a5beb3fb278. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:09:12.956048 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-632d74ed-9225-4602-bb74-1bc6fc014727 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Going to run 1 instances... {{(pid=117274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:09:12.958485 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-632d74ed-9225-4602-bb74-1bc6fc014727 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:09:13.006512 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-7e50e53e-30f8-499b-b72b-7289c8806944 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:13.007674 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-7e50e53e-30f8-499b-b72b-7289c8806944 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:13.016924 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-632d74ed-9225-4602-bb74-1bc6fc014727 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541036 May 16 19:09:13.017998 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 65/152] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:09:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:09:13.019383 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7e50e53e-30f8-499b-b72b-7289c8806944 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:13.020218 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7e50e53e-30f8-499b-b72b-7289c8806944 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:13.021720 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7e50e53e-30f8-499b-b72b-7289c8806944 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:13.022350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7e50e53e-30f8-499b-b72b-7289c8806944 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:13.032039 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c62d9f21-5e90-4674-a429-fe7585a73750 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:13.033206 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c62d9f21-5e90-4674-a429-fe7585a73750 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:13.099785 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c62d9f21-5e90-4674-a429-fe7585a73750 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:13.108249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c62d9f21-5e90-4674-a429-fe7585a73750 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1213 microversion: 2.1 time: 0.082920 May 16 19:09:13.109147 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 66/153] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:13 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:09:13.221569 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-7e50e53e-30f8-499b-b72b-7289c8806944 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:13.230339 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-7e50e53e-30f8-499b-b72b-7289c8806944 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1515 microversion: 2.1 time: 0.231407 May 16 19:09:13.230935 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 88/154] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:12 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1515 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:13.248733 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7366b13d-a7ba-4ff1-8c4a-9d6a59366721 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:13.249795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7366b13d-a7ba-4ff1-8c4a-9d6a59366721 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:13.255713 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7366b13d-a7ba-4ff1-8c4a-9d6a59366721 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:13.256153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7366b13d-a7ba-4ff1-8c4a-9d6a59366721 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:13.256944 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7366b13d-a7ba-4ff1-8c4a-9d6a59366721 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:13.257371 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7366b13d-a7ba-4ff1-8c4a-9d6a59366721 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:13.282632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-7366b13d-a7ba-4ff1-8c4a-9d6a59366721 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lazy-loading 'flavor' on Instance uuid e6fa5413-e91f-461c-8007-e68d68254d4d {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:09:13.423283 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7366b13d-a7ba-4ff1-8c4a-9d6a59366721 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "POST /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d/action" status: 200 len: 32 microversion: 2.1 time: 0.178978 May 16 19:09:13.424051 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 67/155] 10.222.0.24 () {60 vars in 1277 bytes} [Mon May 16 19:09:13 2022] POST /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d/action => generated 32 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 19:09:13.434389 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e32421bf-6516-41c9-93fa-10149f441819 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:13.435347 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e32421bf-6516-41c9-93fa-10149f441819 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:13.441863 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e32421bf-6516-41c9-93fa-10149f441819 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:13.442386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e32421bf-6516-41c9-93fa-10149f441819 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:13.443486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e32421bf-6516-41c9-93fa-10149f441819 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:13.444116 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e32421bf-6516-41c9-93fa-10149f441819 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:13.588183 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e32421bf-6516-41c9-93fa-10149f441819 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:13.596262 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e32421bf-6516-41c9-93fa-10149f441819 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.166724 May 16 19:09:13.605800 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 89/156] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:13 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:14.127243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f3a6e80d-bb51-47cd-95d8-5fe42b4d0170 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:14.128042 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f3a6e80d-bb51-47cd-95d8-5fe42b4d0170 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:14.135453 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f3a6e80d-bb51-47cd-95d8-5fe42b4d0170 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:14.135949 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f3a6e80d-bb51-47cd-95d8-5fe42b4d0170 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:14.136773 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f3a6e80d-bb51-47cd-95d8-5fe42b4d0170 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:14.137287 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f3a6e80d-bb51-47cd-95d8-5fe42b4d0170 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:14.219797 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f3a6e80d-bb51-47cd-95d8-5fe42b4d0170 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:14.234943 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f3a6e80d-bb51-47cd-95d8-5fe42b4d0170 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1217 microversion: 2.1 time: 0.112383 May 16 19:09:14.235731 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 68/157] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:14 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1217 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:14.612419 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-020844da-4363-4410-a7df-83391168f51d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:14.613032 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-020844da-4363-4410-a7df-83391168f51d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:14.619185 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-020844da-4363-4410-a7df-83391168f51d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:14.619634 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-020844da-4363-4410-a7df-83391168f51d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:14.620416 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-020844da-4363-4410-a7df-83391168f51d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:14.620850 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-020844da-4363-4410-a7df-83391168f51d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:14.752271 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-020844da-4363-4410-a7df-83391168f51d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:14.759936 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-020844da-4363-4410-a7df-83391168f51d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.151579 May 16 19:09:14.760509 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 90/158] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:14 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:15.252522 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b7fe2bba-87a1-4143-8d9b-a476fc61ad5e tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:15.253972 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b7fe2bba-87a1-4143-8d9b-a476fc61ad5e tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:15.262509 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b7fe2bba-87a1-4143-8d9b-a476fc61ad5e tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:15.263470 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b7fe2bba-87a1-4143-8d9b-a476fc61ad5e tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:15.264420 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b7fe2bba-87a1-4143-8d9b-a476fc61ad5e tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:15.264985 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b7fe2bba-87a1-4143-8d9b-a476fc61ad5e tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:15.349420 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b7fe2bba-87a1-4143-8d9b-a476fc61ad5e tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:15.358719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b7fe2bba-87a1-4143-8d9b-a476fc61ad5e tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1265 microversion: 2.1 time: 0.110758 May 16 19:09:15.370737 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-75b4ca0b-0c65-4cdd-a192-0e910cec2593 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:15.371466 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-75b4ca0b-0c65-4cdd-a192-0e910cec2593 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:15.375427 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 69/159] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:15 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:15.378819 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-75b4ca0b-0c65-4cdd-a192-0e910cec2593 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:15.379271 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-75b4ca0b-0c65-4cdd-a192-0e910cec2593 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:15.380104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-75b4ca0b-0c65-4cdd-a192-0e910cec2593 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:15.380662 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-75b4ca0b-0c65-4cdd-a192-0e910cec2593 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:15.407273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-75b4ca0b-0c65-4cdd-a192-0e910cec2593 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Going to try to terminate instance {{(pid=117275) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:09:15.503906 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-75b4ca0b-0c65-4cdd-a192-0e910cec2593 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 204 len: 0 microversion: 2.1 time: 0.138426 May 16 19:09:15.504495 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 91/160] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:09:15 2022] DELETE /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 19:09:15.513925 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8d702187-187a-441d-964c-ab57174ffec8 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:15.514605 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8d702187-187a-441d-964c-ab57174ffec8 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:15.521149 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8d702187-187a-441d-964c-ab57174ffec8 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:15.521149 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8d702187-187a-441d-964c-ab57174ffec8 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:15.521845 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8d702187-187a-441d-964c-ab57174ffec8 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:15.522267 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8d702187-187a-441d-964c-ab57174ffec8 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:15.657671 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-8d702187-187a-441d-964c-ab57174ffec8 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:15.665848 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8d702187-187a-441d-964c-ab57174ffec8 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1554 microversion: 2.1 time: 0.156744 May 16 19:09:15.666416 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 70/161] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:15 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:15.777507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-005b563e-8eca-4b9a-823c-cdfeb521d094 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:15.778630 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-005b563e-8eca-4b9a-823c-cdfeb521d094 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:15.784736 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-005b563e-8eca-4b9a-823c-cdfeb521d094 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:15.785157 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-005b563e-8eca-4b9a-823c-cdfeb521d094 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:15.785998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-005b563e-8eca-4b9a-823c-cdfeb521d094 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:15.786445 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-005b563e-8eca-4b9a-823c-cdfeb521d094 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:15.919109 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-005b563e-8eca-4b9a-823c-cdfeb521d094 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:15.927031 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-005b563e-8eca-4b9a-823c-cdfeb521d094 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.153904 May 16 19:09:15.927607 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 92/162] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:15 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:16.376213 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-531797df-bbb1-4ad4-8719-1be2e7d7d8ee tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:16.376925 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-531797df-bbb1-4ad4-8719-1be2e7d7d8ee tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:16.383475 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-531797df-bbb1-4ad4-8719-1be2e7d7d8ee tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:16.383909 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-531797df-bbb1-4ad4-8719-1be2e7d7d8ee tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:16.384716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-531797df-bbb1-4ad4-8719-1be2e7d7d8ee tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:16.385148 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-531797df-bbb1-4ad4-8719-1be2e7d7d8ee tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:16.449556 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-531797df-bbb1-4ad4-8719-1be2e7d7d8ee tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:16.457664 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-531797df-bbb1-4ad4-8719-1be2e7d7d8ee tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1265 microversion: 2.1 time: 0.085595 May 16 19:09:16.458152 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 71/163] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:16 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:16.683760 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b5ed0a9e-48b9-41db-88ae-9987340d4a96 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:16.685308 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b5ed0a9e-48b9-41db-88ae-9987340d4a96 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:16.692396 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b5ed0a9e-48b9-41db-88ae-9987340d4a96 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:16.692779 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b5ed0a9e-48b9-41db-88ae-9987340d4a96 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:16.693650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b5ed0a9e-48b9-41db-88ae-9987340d4a96 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:16.694076 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b5ed0a9e-48b9-41db-88ae-9987340d4a96 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:16.822013 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b5ed0a9e-48b9-41db-88ae-9987340d4a96 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:16.829886 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b5ed0a9e-48b9-41db-88ae-9987340d4a96 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1554 microversion: 2.1 time: 0.150249 May 16 19:09:16.830458 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 93/164] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:16 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:16.947983 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-df346ed0-1e26-4ef2-904a-fbb62520040a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:16.948988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-df346ed0-1e26-4ef2-904a-fbb62520040a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:16.956118 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-df346ed0-1e26-4ef2-904a-fbb62520040a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:16.956567 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-df346ed0-1e26-4ef2-904a-fbb62520040a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:16.957334 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-df346ed0-1e26-4ef2-904a-fbb62520040a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:16.957808 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-df346ed0-1e26-4ef2-904a-fbb62520040a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:17.089789 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-df346ed0-1e26-4ef2-904a-fbb62520040a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:17.097838 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-df346ed0-1e26-4ef2-904a-fbb62520040a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.156313 May 16 19:09:17.098418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 72/165] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:16 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:17.488416 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-60de2505-f584-4b4d-9ef7-2b6329c09fd2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:17.489424 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-60de2505-f584-4b4d-9ef7-2b6329c09fd2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:17.500149 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-60de2505-f584-4b4d-9ef7-2b6329c09fd2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:17.500609 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-60de2505-f584-4b4d-9ef7-2b6329c09fd2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:17.501653 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-60de2505-f584-4b4d-9ef7-2b6329c09fd2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:17.502143 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-60de2505-f584-4b4d-9ef7-2b6329c09fd2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:17.579358 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-60de2505-f584-4b4d-9ef7-2b6329c09fd2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:17.587185 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-60de2505-f584-4b4d-9ef7-2b6329c09fd2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1265 microversion: 2.1 time: 0.115543 May 16 19:09:17.587774 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 94/166] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:17 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:17.851031 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-dfba36b7-d541-4bf0-81d2-574ee17d8ec0 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:17.852085 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-dfba36b7-d541-4bf0-81d2-574ee17d8ec0 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:17.860963 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dfba36b7-d541-4bf0-81d2-574ee17d8ec0 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:17.861413 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dfba36b7-d541-4bf0-81d2-574ee17d8ec0 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:17.862221 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dfba36b7-d541-4bf0-81d2-574ee17d8ec0 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:17.862654 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dfba36b7-d541-4bf0-81d2-574ee17d8ec0 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:18.002961 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-dfba36b7-d541-4bf0-81d2-574ee17d8ec0 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:18.011769 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-dfba36b7-d541-4bf0-81d2-574ee17d8ec0 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1554 microversion: 2.1 time: 0.167285 May 16 19:09:18.012358 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 73/167] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:17 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:18.118951 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d3df6f91-b051-46e7-9c48-1e219d06f6aa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:18.119917 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d3df6f91-b051-46e7-9c48-1e219d06f6aa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:18.127723 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d3df6f91-b051-46e7-9c48-1e219d06f6aa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:18.128168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d3df6f91-b051-46e7-9c48-1e219d06f6aa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:18.128935 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d3df6f91-b051-46e7-9c48-1e219d06f6aa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:18.129362 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d3df6f91-b051-46e7-9c48-1e219d06f6aa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:18.261494 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d3df6f91-b051-46e7-9c48-1e219d06f6aa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:18.269019 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d3df6f91-b051-46e7-9c48-1e219d06f6aa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.156569 May 16 19:09:18.269587 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 95/168] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:18 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:18.606785 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9e265486-c5c0-41de-920c-34b9f50bb3a4 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:18.607280 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9e265486-c5c0-41de-920c-34b9f50bb3a4 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:18.614221 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9e265486-c5c0-41de-920c-34b9f50bb3a4 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:18.614672 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9e265486-c5c0-41de-920c-34b9f50bb3a4 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:18.615450 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9e265486-c5c0-41de-920c-34b9f50bb3a4 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:18.615882 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9e265486-c5c0-41de-920c-34b9f50bb3a4 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:18.677420 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9e265486-c5c0-41de-920c-34b9f50bb3a4 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:18.686806 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9e265486-c5c0-41de-920c-34b9f50bb3a4 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1273 microversion: 2.1 time: 0.085721 May 16 19:09:18.687354 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 74/169] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:18 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:19.031029 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-25be1f88-dfae-43b9-8be3-e1013aefe538 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:19.031705 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-25be1f88-dfae-43b9-8be3-e1013aefe538 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:19.038721 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-25be1f88-dfae-43b9-8be3-e1013aefe538 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:19.039191 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-25be1f88-dfae-43b9-8be3-e1013aefe538 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:19.040089 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-25be1f88-dfae-43b9-8be3-e1013aefe538 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:19.040520 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-25be1f88-dfae-43b9-8be3-e1013aefe538 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:19.173405 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-25be1f88-dfae-43b9-8be3-e1013aefe538 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:19.181471 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-25be1f88-dfae-43b9-8be3-e1013aefe538 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1554 microversion: 2.1 time: 0.156784 May 16 19:09:19.182045 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 96/170] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:19 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:19.286346 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-835753c5-f029-4997-b0fe-00d34b81ed4d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:19.287003 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-835753c5-f029-4997-b0fe-00d34b81ed4d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:19.293397 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-835753c5-f029-4997-b0fe-00d34b81ed4d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:19.293863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-835753c5-f029-4997-b0fe-00d34b81ed4d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:19.294620 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-835753c5-f029-4997-b0fe-00d34b81ed4d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:19.295252 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-835753c5-f029-4997-b0fe-00d34b81ed4d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:19.425303 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-835753c5-f029-4997-b0fe-00d34b81ed4d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:19.432937 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-835753c5-f029-4997-b0fe-00d34b81ed4d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.150226 May 16 19:09:19.433719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 75/171] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:19 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:19.709639 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4644859b-b0a3-4235-9fa6-c9f4e22cce31 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:19.710403 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-4644859b-b0a3-4235-9fa6-c9f4e22cce31 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:19.718873 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4644859b-b0a3-4235-9fa6-c9f4e22cce31 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:19.719313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4644859b-b0a3-4235-9fa6-c9f4e22cce31 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:19.720079 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4644859b-b0a3-4235-9fa6-c9f4e22cce31 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:19.720480 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4644859b-b0a3-4235-9fa6-c9f4e22cce31 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:19.780135 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4644859b-b0a3-4235-9fa6-c9f4e22cce31 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:19.788262 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4644859b-b0a3-4235-9fa6-c9f4e22cce31 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1273 microversion: 2.1 time: 0.084323 May 16 19:09:19.788844 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 97/172] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:19 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:20.199572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4a0cb930-cc33-450e-81d3-8b2489bcbf95 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:20.199697 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-4a0cb930-cc33-450e-81d3-8b2489bcbf95 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:20.206226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4a0cb930-cc33-450e-81d3-8b2489bcbf95 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:20.206679 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4a0cb930-cc33-450e-81d3-8b2489bcbf95 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:20.207456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4a0cb930-cc33-450e-81d3-8b2489bcbf95 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:20.207889 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4a0cb930-cc33-450e-81d3-8b2489bcbf95 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:20.360213 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4a0cb930-cc33-450e-81d3-8b2489bcbf95 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:20.374247 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4a0cb930-cc33-450e-81d3-8b2489bcbf95 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1554 microversion: 2.1 time: 0.178931 May 16 19:09:20.375064 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 76/173] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:20 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:20.449814 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8e06e436-456c-4b4f-8f80-1d49d4d25031 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:20.450420 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8e06e436-456c-4b4f-8f80-1d49d4d25031 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:20.456796 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8e06e436-456c-4b4f-8f80-1d49d4d25031 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:20.457235 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8e06e436-456c-4b4f-8f80-1d49d4d25031 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:20.458026 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8e06e436-456c-4b4f-8f80-1d49d4d25031 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:20.458452 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8e06e436-456c-4b4f-8f80-1d49d4d25031 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:20.592299 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8e06e436-456c-4b4f-8f80-1d49d4d25031 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:20.600033 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8e06e436-456c-4b4f-8f80-1d49d4d25031 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.154155 May 16 19:09:20.600603 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 98/174] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:20 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:20.809159 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f4565a00-8448-499d-bfce-1e6ce7037990 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:20.810209 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f4565a00-8448-499d-bfce-1e6ce7037990 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:20.820446 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f4565a00-8448-499d-bfce-1e6ce7037990 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:20.821207 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f4565a00-8448-499d-bfce-1e6ce7037990 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:20.822642 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f4565a00-8448-499d-bfce-1e6ce7037990 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:20.823400 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f4565a00-8448-499d-bfce-1e6ce7037990 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:21.034183 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f4565a00-8448-499d-bfce-1e6ce7037990 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:21.041557 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f4565a00-8448-499d-bfce-1e6ce7037990 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1271 microversion: 2.1 time: 0.238862 May 16 19:09:21.042160 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 77/175] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:20 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:21.394033 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d5c7950e-4c40-4fbc-8d9d-156dfce74518 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:21.394646 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d5c7950e-4c40-4fbc-8d9d-156dfce74518 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:21.401209 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d5c7950e-4c40-4fbc-8d9d-156dfce74518 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:21.401681 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d5c7950e-4c40-4fbc-8d9d-156dfce74518 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:21.402460 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d5c7950e-4c40-4fbc-8d9d-156dfce74518 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:21.402893 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d5c7950e-4c40-4fbc-8d9d-156dfce74518 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:21.542164 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d5c7950e-4c40-4fbc-8d9d-156dfce74518 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:21.553132 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d5c7950e-4c40-4fbc-8d9d-156dfce74518 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1554 microversion: 2.1 time: 0.163695 May 16 19:09:21.553890 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 99/176] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:21 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:21.621521 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b28e2f8f-3624-4cbd-9e4a-2352e1a4f25f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:21.622604 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b28e2f8f-3624-4cbd-9e4a-2352e1a4f25f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:21.632919 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b28e2f8f-3624-4cbd-9e4a-2352e1a4f25f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:21.633606 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b28e2f8f-3624-4cbd-9e4a-2352e1a4f25f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:21.634876 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b28e2f8f-3624-4cbd-9e4a-2352e1a4f25f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:21.635593 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b28e2f8f-3624-4cbd-9e4a-2352e1a4f25f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:21.774197 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b28e2f8f-3624-4cbd-9e4a-2352e1a4f25f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:21.782685 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b28e2f8f-3624-4cbd-9e4a-2352e1a4f25f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.168364 May 16 19:09:21.783255 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 78/177] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:21 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:22.062693 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c39cd94d-8677-4e60-93f8-a0837dfb80cb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:22.063692 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c39cd94d-8677-4e60-93f8-a0837dfb80cb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:22.074194 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c39cd94d-8677-4e60-93f8-a0837dfb80cb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:22.074937 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c39cd94d-8677-4e60-93f8-a0837dfb80cb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:22.076221 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c39cd94d-8677-4e60-93f8-a0837dfb80cb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:22.076926 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c39cd94d-8677-4e60-93f8-a0837dfb80cb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:22.137309 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c39cd94d-8677-4e60-93f8-a0837dfb80cb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:22.145321 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c39cd94d-8677-4e60-93f8-a0837dfb80cb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1271 microversion: 2.1 time: 0.089166 May 16 19:09:22.145940 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 100/178] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:22 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:22.578975 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-87b2609e-a8e3-4b17-9875-5b5a973dac0e tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:22.579975 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-87b2609e-a8e3-4b17-9875-5b5a973dac0e tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:22.590386 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-87b2609e-a8e3-4b17-9875-5b5a973dac0e tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:22.591126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-87b2609e-a8e3-4b17-9875-5b5a973dac0e tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:22.592388 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-87b2609e-a8e3-4b17-9875-5b5a973dac0e tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:22.593095 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-87b2609e-a8e3-4b17-9875-5b5a973dac0e tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:22.729629 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-87b2609e-a8e3-4b17-9875-5b5a973dac0e tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:22.738220 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-87b2609e-a8e3-4b17-9875-5b5a973dac0e tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1554 microversion: 2.1 time: 0.165804 May 16 19:09:22.738794 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 79/179] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:22 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:22.799837 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ac1d68da-4507-4c52-b1ae-bc1ab58aba12 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:22.800498 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ac1d68da-4507-4c52-b1ae-bc1ab58aba12 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:22.806784 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ac1d68da-4507-4c52-b1ae-bc1ab58aba12 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:22.807235 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ac1d68da-4507-4c52-b1ae-bc1ab58aba12 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:22.808010 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ac1d68da-4507-4c52-b1ae-bc1ab58aba12 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:22.808443 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ac1d68da-4507-4c52-b1ae-bc1ab58aba12 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:22.945896 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ac1d68da-4507-4c52-b1ae-bc1ab58aba12 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:22.953888 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ac1d68da-4507-4c52-b1ae-bc1ab58aba12 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.158014 May 16 19:09:22.954473 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 101/180] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:22 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:23.166492 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2c0a7ad5-578d-4d08-b387-396a7488e8e6 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:23.167508 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2c0a7ad5-578d-4d08-b387-396a7488e8e6 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:23.177929 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c0a7ad5-578d-4d08-b387-396a7488e8e6 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:23.178669 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c0a7ad5-578d-4d08-b387-396a7488e8e6 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:23.179931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c0a7ad5-578d-4d08-b387-396a7488e8e6 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:23.180646 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c0a7ad5-578d-4d08-b387-396a7488e8e6 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:23.245057 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2c0a7ad5-578d-4d08-b387-396a7488e8e6 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:23.252984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2c0a7ad5-578d-4d08-b387-396a7488e8e6 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1271 microversion: 2.1 time: 0.093129 May 16 19:09:23.253571 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 80/181] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:23 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:23.756164 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-cd64e448-00b0-4d80-a917-47851a7f2b1b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:23.757016 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-cd64e448-00b0-4d80-a917-47851a7f2b1b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:23.763365 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cd64e448-00b0-4d80-a917-47851a7f2b1b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:23.763877 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cd64e448-00b0-4d80-a917-47851a7f2b1b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:23.764707 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cd64e448-00b0-4d80-a917-47851a7f2b1b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:23.765218 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cd64e448-00b0-4d80-a917-47851a7f2b1b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:23.971008 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9a7d45b8-6188-453c-9c5c-6277ad89ff18 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:23.972236 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9a7d45b8-6188-453c-9c5c-6277ad89ff18 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:23.979286 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9a7d45b8-6188-453c-9c5c-6277ad89ff18 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:23.979715 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9a7d45b8-6188-453c-9c5c-6277ad89ff18 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:23.980689 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9a7d45b8-6188-453c-9c5c-6277ad89ff18 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:23.981178 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9a7d45b8-6188-453c-9c5c-6277ad89ff18 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:24.107849 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-cd64e448-00b0-4d80-a917-47851a7f2b1b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:24.117469 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9a7d45b8-6188-453c-9c5c-6277ad89ff18 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:24.125459 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9a7d45b8-6188-453c-9c5c-6277ad89ff18 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.158807 May 16 19:09:24.126085 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 81/182] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:23 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:24.136917 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-cd64e448-00b0-4d80-a917-47851a7f2b1b tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1554 microversion: 2.1 time: 0.384740 May 16 19:09:24.137619 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 102/183] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:23 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1554 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:24.270526 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7919a727-bfa8-4d0f-8a49-7cb3a3b6c1ca tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:24.271281 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7919a727-bfa8-4d0f-8a49-7cb3a3b6c1ca tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:24.277469 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7919a727-bfa8-4d0f-8a49-7cb3a3b6c1ca tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:24.278567 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7919a727-bfa8-4d0f-8a49-7cb3a3b6c1ca tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:24.279478 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7919a727-bfa8-4d0f-8a49-7cb3a3b6c1ca tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:24.279964 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7919a727-bfa8-4d0f-8a49-7cb3a3b6c1ca tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:24.412148 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7919a727-bfa8-4d0f-8a49-7cb3a3b6c1ca tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:24.421623 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7919a727-bfa8-4d0f-8a49-7cb3a3b6c1ca tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1313 microversion: 2.1 time: 0.155236 May 16 19:09:24.422518 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 82/184] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:24 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:24.788095 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-eb440834-fa23-4aae-b931-4e69ffaa6687 req-d5a7a124-fdac-4b45-bbb9-ae29ee947704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39fb145-de7f-49c4-ac8f-eacbb6c9a673", "name": "network-vif-deleted", "tag": "2e11282d-6548-42a2-bd7b-f48e111161b1"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:24.798930 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-eb440834-fa23-4aae-b931-4e69ffaa6687 req-d5a7a124-fdac-4b45-bbb9-ae29ee947704 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:24.799439 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-eb440834-fa23-4aae-b931-4e69ffaa6687 req-d5a7a124-fdac-4b45-bbb9-ae29ee947704 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:24.813773 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-eb440834-fa23-4aae-b931-4e69ffaa6687 req-d5a7a124-fdac-4b45-bbb9-ae29ee947704 service nova] Creating event network-vif-deleted:2e11282d-6548-42a2-bd7b-f48e111161b1 for instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 on hv-cinder-76606 May 16 19:09:24.819991 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-eb440834-fa23-4aae-b931-4e69ffaa6687 req-d5a7a124-fdac-4b45-bbb9-ae29ee947704 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035440 May 16 19:09:24.820927 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 103/185] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:09:25.145598 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f65b3f9f-1029-41ca-83d2-b1d5c337f451 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:25.146241 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f65b3f9f-1029-41ca-83d2-b1d5c337f451 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:25.156521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-754a77da-5f16-4e14-b53e-d68007375f37 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:25.157196 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-754a77da-5f16-4e14-b53e-d68007375f37 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:25.171433 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-754a77da-5f16-4e14-b53e-d68007375f37 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:25.171953 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-754a77da-5f16-4e14-b53e-d68007375f37 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:25.173107 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-754a77da-5f16-4e14-b53e-d68007375f37 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:25.174607 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-754a77da-5f16-4e14-b53e-d68007375f37 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:25.179517 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f65b3f9f-1029-41ca-83d2-b1d5c337f451 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:25.180670 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f65b3f9f-1029-41ca-83d2-b1d5c337f451 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:25.181926 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f65b3f9f-1029-41ca-83d2-b1d5c337f451 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:25.182601 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f65b3f9f-1029-41ca-83d2-b1d5c337f451 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:25.275104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-754a77da-5f16-4e14-b53e-d68007375f37 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a312fd71b944188c56c42c94e15324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c29e44eba604e6389ecb2ee2b1059a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:25.285045 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-754a77da-5f16-4e14-b53e-d68007375f37 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 200 len: 1346 microversion: 2.1 time: 0.134615 May 16 19:09:25.285905 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 104/186] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:25 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 1346 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:09:25.367114 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f65b3f9f-1029-41ca-83d2-b1d5c337f451 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:25.374549 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f65b3f9f-1029-41ca-83d2-b1d5c337f451 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.234720 May 16 19:09:25.375209 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 83/187] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:25 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:25.439547 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-39e883a2-e4d7-4ddd-9801-9db7e43df456 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:25.440159 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-39e883a2-e4d7-4ddd-9801-9db7e43df456 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:25.446424 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-39e883a2-e4d7-4ddd-9801-9db7e43df456 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:25.446865 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-39e883a2-e4d7-4ddd-9801-9db7e43df456 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:25.447631 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-39e883a2-e4d7-4ddd-9801-9db7e43df456 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:25.448058 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-39e883a2-e4d7-4ddd-9801-9db7e43df456 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:25.808528 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-39e883a2-e4d7-4ddd-9801-9db7e43df456 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:25.816129 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-39e883a2-e4d7-4ddd-9801-9db7e43df456 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1313 microversion: 2.1 time: 0.380685 May 16 19:09:25.816769 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 105/188] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:25 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:26.303401 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e8e1eae3-fd55-4d2e-abd4-d20bda362982 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:26.304023 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e8e1eae3-fd55-4d2e-abd4-d20bda362982 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:26.310649 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e8e1eae3-fd55-4d2e-abd4-d20bda362982 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:26.311083 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e8e1eae3-fd55-4d2e-abd4-d20bda362982 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:26.311883 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e8e1eae3-fd55-4d2e-abd4-d20bda362982 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:26.312294 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e8e1eae3-fd55-4d2e-abd4-d20bda362982 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:26.327928 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-e8e1eae3-fd55-4d2e-abd4-d20bda362982 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] HTTP exception thrown: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e8e1eae3-fd55-4d2e-abd4-d20bda362982 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Request method failure captured: May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 HTTP/1.1 May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqETSEWKU0idV5586lDuooxthFFVOf0tw9fRX_SLTQYWXc3A_gXZd7NQZfzsbHZmOXkllrVxseDRnlvj5z818bi0hmaBs6aba8bcAQQZ_qJYWmZZBUAjHuqUIbzSxCTwRyErXT9MuRlNZZwFALYcnO320xYNgTsRefsINZVffQVeJ64 May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: 6c29e44eba604e6389ecb2ee2b1059a0 May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-DeleteServersTestJSON-418898645 May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:09:26.333332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:09:26.334804 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6c29e44eba604e6389ecb2ee2b1059a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6c29e44eba604e6389ecb2ee2b1059a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/6c29e44eba604e6389ecb2ee2b1059a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_6c29e44eba604e6389ecb2ee2b1059a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:09:26.334804 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-DeleteServersTestJSON-418898645 May 16 19:09:26.334804 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: 6c29e44eba604e6389ecb2ee2b1059a0 May 16 19:09:26.334804 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-DeleteServersTestJSON-418898645 May 16 19:09:26.334804 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-DeleteServersTestJSON-418898645-project May 16 19:09:26.334804 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:09:26.334804 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:09:26.334804 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: e6a312fd71b944188c56c42c94e15324 May 16 19:09:26.334804 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-DeleteServersTestJSON-418898645-project May 16 19:09:26.334804 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:09:26.334804 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:26.334804 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': 'b39fb145-de7f-49c4-ac8f-eacbb6c9a673'} May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:09:26.335600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:26.336897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:26.339346 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e8e1eae3-fd55-4d2e-abd4-d20bda362982 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Returning 404 to user: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:09:26.339346 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e8e1eae3-fd55-4d2e-abd4-d20bda362982 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 404 len: 111 microversion: 2.1 time: 0.037098 May 16 19:09:26.339679 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 84/189] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:26 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:09:26.394074 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ea64af65-490b-4811-ae4f-198ab89bbb48 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:26.394672 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ea64af65-490b-4811-ae4f-198ab89bbb48 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:26.401293 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ea64af65-490b-4811-ae4f-198ab89bbb48 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:26.401917 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ea64af65-490b-4811-ae4f-198ab89bbb48 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:26.402782 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ea64af65-490b-4811-ae4f-198ab89bbb48 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:26.403604 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ea64af65-490b-4811-ae4f-198ab89bbb48 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:26.465962 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-cb2e0565-87fe-47e2-87fa-abfd86497258 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:26.468096 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-cb2e0565-87fe-47e2-87fa-abfd86497258 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:26.475152 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cb2e0565-87fe-47e2-87fa-abfd86497258 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:26.475534 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cb2e0565-87fe-47e2-87fa-abfd86497258 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:26.476984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cb2e0565-87fe-47e2-87fa-abfd86497258 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:26.477428 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cb2e0565-87fe-47e2-87fa-abfd86497258 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:26.491199 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-cb2e0565-87fe-47e2-87fa-abfd86497258 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] HTTP exception thrown: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-cb2e0565-87fe-47e2-87fa-abfd86497258 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Request method failure captured: May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673/os-volume_attachments HTTP/1.1 May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqETSEWKU0idV5586lDuooxthFFVOf0tw9fRX_SLTQYWXc3A_gXZd7NQZfzsbHZmOXkllrVxseDRnlvj5z818bi0hmaBs6aba8bcAQQZ_qJYWmZZBUAjHuqUIbzSxCTwRyErXT9MuRlNZZwFALYcnO320xYNgTsRefsINZVffQVeJ64 May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: 6c29e44eba604e6389ecb2ee2b1059a0 May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-DeleteServersTestJSON-418898645 May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:09:26.493429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:09:26.494692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6c29e44eba604e6389ecb2ee2b1059a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6c29e44eba604e6389ecb2ee2b1059a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/6c29e44eba604e6389ecb2ee2b1059a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_6c29e44eba604e6389ecb2ee2b1059a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:09:26.494692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-DeleteServersTestJSON-418898645 May 16 19:09:26.494692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: 6c29e44eba604e6389ecb2ee2b1059a0 May 16 19:09:26.494692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-DeleteServersTestJSON-418898645 May 16 19:09:26.494692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-DeleteServersTestJSON-418898645-project May 16 19:09:26.494692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:09:26.494692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:09:26.494692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: e6a312fd71b944188c56c42c94e15324 May 16 19:09:26.494692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-DeleteServersTestJSON-418898645-project May 16 19:09:26.494692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:09:26.494692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:26.494692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'server_id': 'b39fb145-de7f-49c4-ac8f-eacbb6c9a673'} May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:09:26.495449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:26.496462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:26.497599 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-cb2e0565-87fe-47e2-87fa-abfd86497258 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Returning 404 to user: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:09:26.497599 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-cb2e0565-87fe-47e2-87fa-abfd86497258 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033470 May 16 19:09:26.499007 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 85/190] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:09:26 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 19:09:26.549725 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ea64af65-490b-4811-ae4f-198ab89bbb48 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:26.554135 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ea64af65-490b-4811-ae4f-198ab89bbb48 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.164381 May 16 19:09:26.564407 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 106/191] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:26 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:26.836158 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0436949e-2b85-47fe-8b55-c1bf3873b3d3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:26.836895 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0436949e-2b85-47fe-8b55-c1bf3873b3d3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:26.838889 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-884bc156-e3d8-4a13-80d8-d517bd0bc001 req-c2cddda4-65b5-4e75-8d57-f5fc2c7b6328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a563cc-0788-4993-91c2-7f0976323bfa", "tag": "9a0b2d2a-1fef-4dea-90a4-8048e7ae84e6"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:26.843774 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0436949e-2b85-47fe-8b55-c1bf3873b3d3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:26.844263 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0436949e-2b85-47fe-8b55-c1bf3873b3d3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:26.845039 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0436949e-2b85-47fe-8b55-c1bf3873b3d3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:26.845660 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0436949e-2b85-47fe-8b55-c1bf3873b3d3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:26.850468 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-884bc156-e3d8-4a13-80d8-d517bd0bc001 req-c2cddda4-65b5-4e75-8d57-f5fc2c7b6328 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:26.851125 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-884bc156-e3d8-4a13-80d8-d517bd0bc001 req-c2cddda4-65b5-4e75-8d57-f5fc2c7b6328 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:26.863814 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-884bc156-e3d8-4a13-80d8-d517bd0bc001 req-c2cddda4-65b5-4e75-8d57-f5fc2c7b6328 service nova] Creating event network-changed:9a0b2d2a-1fef-4dea-90a4-8048e7ae84e6 for instance 82a563cc-0788-4993-91c2-7f0976323bfa on hv-cinder-76606 May 16 19:09:26.870022 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-884bc156-e3d8-4a13-80d8-d517bd0bc001 req-c2cddda4-65b5-4e75-8d57-f5fc2c7b6328 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034682 May 16 19:09:26.870884 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 107/192] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:09:27.021006 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0436949e-2b85-47fe-8b55-c1bf3873b3d3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:27.029390 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0436949e-2b85-47fe-8b55-c1bf3873b3d3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1313 microversion: 2.1 time: 0.198728 May 16 19:09:27.029995 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 86/193] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:26 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:27.572602 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-367803fb-10fb-4cdc-b72f-c9d92d8ecdb9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:27.574063 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-367803fb-10fb-4cdc-b72f-c9d92d8ecdb9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:27.580828 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-367803fb-10fb-4cdc-b72f-c9d92d8ecdb9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:27.581604 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-367803fb-10fb-4cdc-b72f-c9d92d8ecdb9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:27.582541 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-367803fb-10fb-4cdc-b72f-c9d92d8ecdb9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:27.583113 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-367803fb-10fb-4cdc-b72f-c9d92d8ecdb9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:27.700369 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-bd040694-9ac1-4fc7-bfe6-0469c9bd8aaa tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:27.701670 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-bd040694-9ac1-4fc7-bfe6-0469c9bd8aaa tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:27.711278 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd040694-9ac1-4fc7-bfe6-0469c9bd8aaa tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:27.711993 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd040694-9ac1-4fc7-bfe6-0469c9bd8aaa tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:27.713083 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd040694-9ac1-4fc7-bfe6-0469c9bd8aaa tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:27.713774 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd040694-9ac1-4fc7-bfe6-0469c9bd8aaa tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:27.730950 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-bd040694-9ac1-4fc7-bfe6-0469c9bd8aaa tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] HTTP exception thrown: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-bd040694-9ac1-4fc7-bfe6-0469c9bd8aaa tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Request method failure captured: May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: DELETE /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 HTTP/1.1 May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqETSEWKU0idV5586lDuooxthFFVOf0tw9fRX_SLTQYWXc3A_gXZd7NQZfzsbHZmOXkllrVxseDRnlvj5z818bi0hmaBs6aba8bcAQQZ_qJYWmZZBUAjHuqUIbzSxCTwRyErXT9MuRlNZZwFALYcnO320xYNgTsRefsINZVffQVeJ64 May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: 6c29e44eba604e6389ecb2ee2b1059a0 May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-DeleteServersTestJSON-418898645 May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:09:27.733618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:09:27.734903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6c29e44eba604e6389ecb2ee2b1059a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6c29e44eba604e6389ecb2ee2b1059a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/6c29e44eba604e6389ecb2ee2b1059a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_6c29e44eba604e6389ecb2ee2b1059a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:09:27.734903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-DeleteServersTestJSON-418898645 May 16 19:09:27.734903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: 6c29e44eba604e6389ecb2ee2b1059a0 May 16 19:09:27.734903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-DeleteServersTestJSON-418898645 May 16 19:09:27.734903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-DeleteServersTestJSON-418898645-project May 16 19:09:27.734903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:09:27.734903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:09:27.734903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: e6a312fd71b944188c56c42c94e15324 May 16 19:09:27.734903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-DeleteServersTestJSON-418898645-project May 16 19:09:27.734903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:09:27.734903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:27.734903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': 'b39fb145-de7f-49c4-ac8f-eacbb6c9a673'} May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:09:27.735560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:27.736572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:27.739247 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-bd040694-9ac1-4fc7-bfe6-0469c9bd8aaa tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Returning 404 to user: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:09:27.740126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-bd040694-9ac1-4fc7-bfe6-0469c9bd8aaa tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 404 len: 111 microversion: 2.1 time: 0.044548 May 16 19:09:27.744206 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 87/194] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:09:27 2022] DELETE /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 19:09:27.749707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ef3a27b0-29ba-46ef-89e7-a5a19fbe7b45 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:27.750385 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ef3a27b0-29ba-46ef-89e7-a5a19fbe7b45 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] [instance: b39fb145-de7f-49c4-ac8f-eacbb6c9a673] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:27.757092 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ef3a27b0-29ba-46ef-89e7-a5a19fbe7b45 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:27.757585 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ef3a27b0-29ba-46ef-89e7-a5a19fbe7b45 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:27.758349 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ef3a27b0-29ba-46ef-89e7-a5a19fbe7b45 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:27.759134 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ef3a27b0-29ba-46ef-89e7-a5a19fbe7b45 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:27.775686 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-ef3a27b0-29ba-46ef-89e7-a5a19fbe7b45 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] HTTP exception thrown: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ef3a27b0-29ba-46ef-89e7-a5a19fbe7b45 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Request method failure captured: May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 HTTP/1.1 May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqETSEWKU0idV5586lDuooxthFFVOf0tw9fRX_SLTQYWXc3A_gXZd7NQZfzsbHZmOXkllrVxseDRnlvj5z818bi0hmaBs6aba8bcAQQZ_qJYWmZZBUAjHuqUIbzSxCTwRyErXT9MuRlNZZwFALYcnO320xYNgTsRefsINZVffQVeJ64 May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: 6c29e44eba604e6389ecb2ee2b1059a0 May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-DeleteServersTestJSON-418898645 May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:09:27.777580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:09:27.779168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6c29e44eba604e6389ecb2ee2b1059a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6c29e44eba604e6389ecb2ee2b1059a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/6c29e44eba604e6389ecb2ee2b1059a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_6c29e44eba604e6389ecb2ee2b1059a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:09:27.779168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-DeleteServersTestJSON-418898645 May 16 19:09:27.779168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: 6c29e44eba604e6389ecb2ee2b1059a0 May 16 19:09:27.779168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-DeleteServersTestJSON-418898645 May 16 19:09:27.779168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-DeleteServersTestJSON-418898645-project May 16 19:09:27.779168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:09:27.779168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:09:27.779168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: e6a312fd71b944188c56c42c94e15324 May 16 19:09:27.779168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-DeleteServersTestJSON-418898645-project May 16 19:09:27.779168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:09:27.779168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:27.779168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': 'b39fb145-de7f-49c4-ac8f-eacbb6c9a673'} May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:09:27.779795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. May 16 19:09:27.780772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:27.783260 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ef3a27b0-29ba-46ef-89e7-a5a19fbe7b45 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] Returning 404 to user: Instance b39fb145-de7f-49c4-ac8f-eacbb6c9a673 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:09:27.784296 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ef3a27b0-29ba-46ef-89e7-a5a19fbe7b45 tempest-DeleteServersTestJSON-418898645 tempest-DeleteServersTestJSON-418898645-project] 10.222.0.24 "GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673" status: 404 len: 111 microversion: 2.1 time: 0.039066 May 16 19:09:27.797201 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 88/195] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:27 2022] GET /compute/v2.1/servers/b39fb145-de7f-49c4-ac8f-eacbb6c9a673 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:09:28.046541 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-77fabc54-faca-40a3-90f5-dd71ccf5b3cc tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:28.047278 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-77fabc54-faca-40a3-90f5-dd71ccf5b3cc tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:28.053470 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-77fabc54-faca-40a3-90f5-dd71ccf5b3cc tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:28.054346 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-77fabc54-faca-40a3-90f5-dd71ccf5b3cc tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:28.055294 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-77fabc54-faca-40a3-90f5-dd71ccf5b3cc tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:28.055863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-77fabc54-faca-40a3-90f5-dd71ccf5b3cc tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:28.093396 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-367803fb-10fb-4cdc-b72f-c9d92d8ecdb9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:28.101896 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-367803fb-10fb-4cdc-b72f-c9d92d8ecdb9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.533620 May 16 19:09:28.102701 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 108/196] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:27 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:28.221206 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-77fabc54-faca-40a3-90f5-dd71ccf5b3cc tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:28.230187 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-77fabc54-faca-40a3-90f5-dd71ccf5b3cc tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1313 microversion: 2.1 time: 0.187666 May 16 19:09:28.233050 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 89/197] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:28 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:09:29.119802 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b142da8e-e2c3-4c8f-b853-7450964d65d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:29.121014 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b142da8e-e2c3-4c8f-b853-7450964d65d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:29.131259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b142da8e-e2c3-4c8f-b853-7450964d65d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:29.131979 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b142da8e-e2c3-4c8f-b853-7450964d65d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:29.132923 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b142da8e-e2c3-4c8f-b853-7450964d65d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:29.133503 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b142da8e-e2c3-4c8f-b853-7450964d65d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:29.250716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a7dba309-1fc4-49b8-8076-a0da4d3f859c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:29.252560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a7dba309-1fc4-49b8-8076-a0da4d3f859c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:29.262280 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a7dba309-1fc4-49b8-8076-a0da4d3f859c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:29.262854 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a7dba309-1fc4-49b8-8076-a0da4d3f859c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:29.263767 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a7dba309-1fc4-49b8-8076-a0da4d3f859c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:29.264228 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a7dba309-1fc4-49b8-8076-a0da4d3f859c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:29.294481 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b142da8e-e2c3-4c8f-b853-7450964d65d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:29.302908 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b142da8e-e2c3-4c8f-b853-7450964d65d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.187592 May 16 19:09:29.304329 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 109/198] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:29 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:29.450869 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a7dba309-1fc4-49b8-8076-a0da4d3f859c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:29.458286 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a7dba309-1fc4-49b8-8076-a0da4d3f859c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1313 microversion: 2.1 time: 0.212650 May 16 19:09:29.459030 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 90/199] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:29 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:09:29.502520 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b7ac8918-dcdb-4cf1-9dea-f42e3df4de3a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-60510960", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452"}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:29.554188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.network.neutron [None req-b7ac8918-dcdb-4cf1-9dea-f42e3df4de3a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] validate_networks() for None {{(pid=117275) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:09:29.851908 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-b7ac8918-dcdb-4cf1-9dea-f42e3df4de3a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Flavor limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:09:29.852663 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-b7ac8918-dcdb-4cf1-9dea-f42e3df4de3a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Image limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:09:29.853287 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-b7ac8918-dcdb-4cf1-9dea-f42e3df4de3a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Flavor pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:09:29.853875 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-b7ac8918-dcdb-4cf1-9dea-f42e3df4de3a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Image pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:09:29.854738 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-b7ac8918-dcdb-4cf1-9dea-f42e3df4de3a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:09:29.863591 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b7ac8918-dcdb-4cf1-9dea-f42e3df4de3a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:29.864228 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b7ac8918-dcdb-4cf1-9dea-f42e3df4de3a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:29.865023 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b7ac8918-dcdb-4cf1-9dea-f42e3df4de3a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:29.865453 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b7ac8918-dcdb-4cf1-9dea-f42e3df4de3a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:29.882220 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-b7ac8918-dcdb-4cf1-9dea-f42e3df4de3a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Getting quotas for project 053d1449368243acad7c389435ec357c. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:09:29.886284 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-b7ac8918-dcdb-4cf1-9dea-f42e3df4de3a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Getting quotas for user fa54a47a738c4b65b13f08921a7f76af and project 053d1449368243acad7c389435ec357c. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:09:29.899708 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b7ac8918-dcdb-4cf1-9dea-f42e3df4de3a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Going to run 1 instances... {{(pid=117275) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:09:29.902268 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b7ac8918-dcdb-4cf1-9dea-f42e3df4de3a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:09:29.948350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b7ac8918-dcdb-4cf1-9dea-f42e3df4de3a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.449672 May 16 19:09:29.949184 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 110/200] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:09:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 19:09:29.960981 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-421253df-f7f1-4427-b211-835adab6d9a0 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:29.962220 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-421253df-f7f1-4427-b211-835adab6d9a0 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:30.037257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-421253df-f7f1-4427-b211-835adab6d9a0 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa54a47a738c4b65b13f08921a7f76af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053d1449368243acad7c389435ec357c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:30.044416 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-421253df-f7f1-4427-b211-835adab6d9a0 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 200 len: 1213 microversion: 2.1 time: 0.089107 May 16 19:09:30.047451 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 91/201] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:29 2022] GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:30.324683 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-666cdf09-743e-4cd6-90eb-b015d972aa39 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:30.326064 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-666cdf09-743e-4cd6-90eb-b015d972aa39 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:30.335077 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-666cdf09-743e-4cd6-90eb-b015d972aa39 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:30.335530 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-666cdf09-743e-4cd6-90eb-b015d972aa39 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:30.336388 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-666cdf09-743e-4cd6-90eb-b015d972aa39 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:30.336846 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-666cdf09-743e-4cd6-90eb-b015d972aa39 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:30.475555 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a23b1804-4037-4abd-8a73-65f020aa49d5 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:30.478299 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a23b1804-4037-4abd-8a73-65f020aa49d5 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:30.486629 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a23b1804-4037-4abd-8a73-65f020aa49d5 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:30.494193 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a23b1804-4037-4abd-8a73-65f020aa49d5 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:30.495929 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a23b1804-4037-4abd-8a73-65f020aa49d5 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:30.496556 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a23b1804-4037-4abd-8a73-65f020aa49d5 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:30.501910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-666cdf09-743e-4cd6-90eb-b015d972aa39 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:30.511105 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-666cdf09-743e-4cd6-90eb-b015d972aa39 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.194563 May 16 19:09:30.522597 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 111/202] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:30 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:30.670666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-eec8c942-a4f8-4cc9-ae60-f0e00685fe32 req-2223f8a4-8587-4f3e-8206-d8b7b7c1f2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a563cc-0788-4993-91c2-7f0976323bfa", "name": "network-vif-plugged", "status": "completed", "tag": "9a0b2d2a-1fef-4dea-90a4-8048e7ae84e6"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:30.684857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-eec8c942-a4f8-4cc9-ae60-f0e00685fe32 req-2223f8a4-8587-4f3e-8206-d8b7b7c1f2f1 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:30.685311 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-eec8c942-a4f8-4cc9-ae60-f0e00685fe32 req-2223f8a4-8587-4f3e-8206-d8b7b7c1f2f1 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:30.688951 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a23b1804-4037-4abd-8a73-65f020aa49d5 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:30.700222 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-eec8c942-a4f8-4cc9-ae60-f0e00685fe32 req-2223f8a4-8587-4f3e-8206-d8b7b7c1f2f1 service nova] Creating event network-vif-plugged:9a0b2d2a-1fef-4dea-90a4-8048e7ae84e6 for instance 82a563cc-0788-4993-91c2-7f0976323bfa on hv-cinder-76606 May 16 19:09:30.702429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a23b1804-4037-4abd-8a73-65f020aa49d5 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1313 microversion: 2.1 time: 0.230661 May 16 19:09:30.706295 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 92/203] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:30 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:30.715403 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-eec8c942-a4f8-4cc9-ae60-f0e00685fe32 req-2223f8a4-8587-4f3e-8206-d8b7b7c1f2f1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048614 May 16 19:09:30.716349 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 112/204] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:09:31.063730 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-cf29ae76-4a63-4e10-b8ee-7e747fee0ca8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:31.064365 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-cf29ae76-4a63-4e10-b8ee-7e747fee0ca8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:31.071055 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cf29ae76-4a63-4e10-b8ee-7e747fee0ca8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:31.071702 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cf29ae76-4a63-4e10-b8ee-7e747fee0ca8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:31.072625 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cf29ae76-4a63-4e10-b8ee-7e747fee0ca8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:31.073192 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cf29ae76-4a63-4e10-b8ee-7e747fee0ca8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:31.162494 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-cf29ae76-4a63-4e10-b8ee-7e747fee0ca8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa54a47a738c4b65b13f08921a7f76af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053d1449368243acad7c389435ec357c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:31.171984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-cf29ae76-4a63-4e10-b8ee-7e747fee0ca8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 200 len: 1265 microversion: 2.1 time: 0.112231 May 16 19:09:31.173668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 93/205] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:31 2022] GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 1265 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:31.528918 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-07aff616-73c5-49bb-b4e0-dd2a6842ee76 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:31.530171 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-07aff616-73c5-49bb-b4e0-dd2a6842ee76 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:31.537125 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-07aff616-73c5-49bb-b4e0-dd2a6842ee76 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:31.537697 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-07aff616-73c5-49bb-b4e0-dd2a6842ee76 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:31.538566 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-07aff616-73c5-49bb-b4e0-dd2a6842ee76 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:31.539088 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-07aff616-73c5-49bb-b4e0-dd2a6842ee76 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:31.719792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-66712933-1b30-4a24-916f-fdd6e32c98da tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:31.720481 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-66712933-1b30-4a24-916f-fdd6e32c98da tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:31.727288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-66712933-1b30-4a24-916f-fdd6e32c98da tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:31.727696 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-66712933-1b30-4a24-916f-fdd6e32c98da tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:31.728647 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-66712933-1b30-4a24-916f-fdd6e32c98da tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:31.729070 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-66712933-1b30-4a24-916f-fdd6e32c98da tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:31.747119 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-07aff616-73c5-49bb-b4e0-dd2a6842ee76 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:31.762891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-07aff616-73c5-49bb-b4e0-dd2a6842ee76 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.238211 May 16 19:09:31.763769 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 113/206] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:31 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:09:31.911007 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-66712933-1b30-4a24-916f-fdd6e32c98da tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:31.921829 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-66712933-1b30-4a24-916f-fdd6e32c98da tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1313 microversion: 2.1 time: 0.204226 May 16 19:09:31.932470 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 94/207] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:31 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:32.189722 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0fff97c7-ef24-406b-9d7a-114b9bf35294 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:32.193734 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0fff97c7-ef24-406b-9d7a-114b9bf35294 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:32.199929 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0fff97c7-ef24-406b-9d7a-114b9bf35294 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:32.200367 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0fff97c7-ef24-406b-9d7a-114b9bf35294 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:32.201170 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0fff97c7-ef24-406b-9d7a-114b9bf35294 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:32.201623 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0fff97c7-ef24-406b-9d7a-114b9bf35294 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:32.290836 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0fff97c7-ef24-406b-9d7a-114b9bf35294 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa54a47a738c4b65b13f08921a7f76af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053d1449368243acad7c389435ec357c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:32.301485 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0fff97c7-ef24-406b-9d7a-114b9bf35294 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 200 len: 1271 microversion: 2.1 time: 0.115988 May 16 19:09:32.302112 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 114/208] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:32 2022] GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:32.780799 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ec37a9d4-ce6c-4600-b88e-639f6d06fc05 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:32.781561 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ec37a9d4-ce6c-4600-b88e-639f6d06fc05 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:32.788307 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec37a9d4-ce6c-4600-b88e-639f6d06fc05 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:32.788858 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec37a9d4-ce6c-4600-b88e-639f6d06fc05 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:32.790026 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec37a9d4-ce6c-4600-b88e-639f6d06fc05 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:32.790546 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec37a9d4-ce6c-4600-b88e-639f6d06fc05 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:32.947115 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9ecc45f6-b882-4485-b514-e551c70c5eb6 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:32.947741 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9ecc45f6-b882-4485-b514-e551c70c5eb6 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:32.955115 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9ecc45f6-b882-4485-b514-e551c70c5eb6 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:32.955552 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9ecc45f6-b882-4485-b514-e551c70c5eb6 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:32.956505 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9ecc45f6-b882-4485-b514-e551c70c5eb6 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:32.957089 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9ecc45f6-b882-4485-b514-e551c70c5eb6 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:32.975450 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ec37a9d4-ce6c-4600-b88e-639f6d06fc05 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:32.984100 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ec37a9d4-ce6c-4600-b88e-639f6d06fc05 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.207601 May 16 19:09:32.984866 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 95/209] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:32 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:33.207252 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-9ecc45f6-b882-4485-b514-e551c70c5eb6 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:33.218549 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9ecc45f6-b882-4485-b514-e551c70c5eb6 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1313 microversion: 2.1 time: 0.279678 May 16 19:09:33.228828 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 115/210] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:32 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:33.280227 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-ae69e9b7-4df9-4364-b19d-89fded2d75f3 req-0dd6c91f-7b09-4e8d-96fb-2043ff34ee11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933c056a-93c1-4871-a304-680d94161112", "tag": "984c76d4-84ac-4c34-9a5d-a268247fba7d"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:33.304959 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-ae69e9b7-4df9-4364-b19d-89fded2d75f3 req-0dd6c91f-7b09-4e8d-96fb-2043ff34ee11 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:33.306683 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-ae69e9b7-4df9-4364-b19d-89fded2d75f3 req-0dd6c91f-7b09-4e8d-96fb-2043ff34ee11 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:33.319972 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c2e6250e-99ec-466c-9bbc-5a936d4b6233 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:33.320613 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c2e6250e-99ec-466c-9bbc-5a936d4b6233 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:33.328541 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-ae69e9b7-4df9-4364-b19d-89fded2d75f3 req-0dd6c91f-7b09-4e8d-96fb-2043ff34ee11 service nova] Creating event network-changed:984c76d4-84ac-4c34-9a5d-a268247fba7d for instance 933c056a-93c1-4871-a304-680d94161112 on hv-cinder-76606 May 16 19:09:33.330954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c2e6250e-99ec-466c-9bbc-5a936d4b6233 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:33.331423 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c2e6250e-99ec-466c-9bbc-5a936d4b6233 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:33.332213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c2e6250e-99ec-466c-9bbc-5a936d4b6233 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:33.332646 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c2e6250e-99ec-466c-9bbc-5a936d4b6233 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:33.336955 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-ae69e9b7-4df9-4364-b19d-89fded2d75f3 req-0dd6c91f-7b09-4e8d-96fb-2043ff34ee11 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060580 May 16 19:09:33.337839 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 96/211] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:09:33.568693 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c2e6250e-99ec-466c-9bbc-5a936d4b6233 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa54a47a738c4b65b13f08921a7f76af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053d1449368243acad7c389435ec357c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:33.575968 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c2e6250e-99ec-466c-9bbc-5a936d4b6233 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 200 len: 1313 microversion: 2.1 time: 0.261025 May 16 19:09:33.586655 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 116/212] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:33 2022] GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:34.001628 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8e00be97-1ac8-41f1-b2a7-2f6ec509c0ff tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:34.002937 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8e00be97-1ac8-41f1-b2a7-2f6ec509c0ff tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:34.010244 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8e00be97-1ac8-41f1-b2a7-2f6ec509c0ff tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:34.010867 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8e00be97-1ac8-41f1-b2a7-2f6ec509c0ff tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:34.011637 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8e00be97-1ac8-41f1-b2a7-2f6ec509c0ff tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:34.012063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8e00be97-1ac8-41f1-b2a7-2f6ec509c0ff tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:34.163612 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-8e00be97-1ac8-41f1-b2a7-2f6ec509c0ff tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:34.175570 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8e00be97-1ac8-41f1-b2a7-2f6ec509c0ff tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.178514 May 16 19:09:34.176429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 97/213] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:33 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:34.235866 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-013c655a-d601-4268-9e5d-898a34d234c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:34.236387 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-013c655a-d601-4268-9e5d-898a34d234c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:34.242823 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-013c655a-d601-4268-9e5d-898a34d234c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:34.243253 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-013c655a-d601-4268-9e5d-898a34d234c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:34.244681 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-013c655a-d601-4268-9e5d-898a34d234c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:34.244681 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-013c655a-d601-4268-9e5d-898a34d234c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:34.383849 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-013c655a-d601-4268-9e5d-898a34d234c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:34.391344 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-013c655a-d601-4268-9e5d-898a34d234c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1497 microversion: 2.1 time: 0.159515 May 16 19:09:34.391919 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 117/214] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:34 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:34.592579 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b043ed74-37cb-4fbe-9773-be8c7f545971 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:34.593287 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b043ed74-37cb-4fbe-9773-be8c7f545971 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:34.601114 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b043ed74-37cb-4fbe-9773-be8c7f545971 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:34.601815 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b043ed74-37cb-4fbe-9773-be8c7f545971 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:34.602856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b043ed74-37cb-4fbe-9773-be8c7f545971 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:34.603357 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b043ed74-37cb-4fbe-9773-be8c7f545971 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:34.772625 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b043ed74-37cb-4fbe-9773-be8c7f545971 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa54a47a738c4b65b13f08921a7f76af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053d1449368243acad7c389435ec357c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:34.780479 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b043ed74-37cb-4fbe-9773-be8c7f545971 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 200 len: 1313 microversion: 2.1 time: 0.191922 May 16 19:09:34.781606 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 98/215] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:34 2022] GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:35.096331 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9ed5e9a0-805b-48a6-bfeb-6194f0fd2c4c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:35.096874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9ed5e9a0-805b-48a6-bfeb-6194f0fd2c4c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:35.103301 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9ed5e9a0-805b-48a6-bfeb-6194f0fd2c4c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:35.103840 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9ed5e9a0-805b-48a6-bfeb-6194f0fd2c4c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:35.104836 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9ed5e9a0-805b-48a6-bfeb-6194f0fd2c4c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:35.105417 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9ed5e9a0-805b-48a6-bfeb-6194f0fd2c4c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:35.135225 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9ed5e9a0-805b-48a6-bfeb-6194f0fd2c4c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Going to try to terminate instance {{(pid=117275) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:09:35.200552 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-1d058b32-526c-4187-8d25-f4a3aff07688 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:35.201801 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-1d058b32-526c-4187-8d25-f4a3aff07688 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:35.209505 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1d058b32-526c-4187-8d25-f4a3aff07688 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:35.210265 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1d058b32-526c-4187-8d25-f4a3aff07688 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:35.211373 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1d058b32-526c-4187-8d25-f4a3aff07688 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:35.212112 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1d058b32-526c-4187-8d25-f4a3aff07688 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:35.221070 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9ed5e9a0-805b-48a6-bfeb-6194f0fd2c4c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "DELETE /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 204 len: 0 microversion: 2.1 time: 0.139838 May 16 19:09:35.221880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 118/216] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:09:35 2022] DELETE /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 19:09:35.232268 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ebb643e3-952f-47bf-bc7c-4610e03264d2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:35.232976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ebb643e3-952f-47bf-bc7c-4610e03264d2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:35.247882 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ebb643e3-952f-47bf-bc7c-4610e03264d2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:35.249110 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ebb643e3-952f-47bf-bc7c-4610e03264d2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:35.249979 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ebb643e3-952f-47bf-bc7c-4610e03264d2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:35.250410 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ebb643e3-952f-47bf-bc7c-4610e03264d2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:35.359832 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-1d058b32-526c-4187-8d25-f4a3aff07688 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:35.367386 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-1d058b32-526c-4187-8d25-f4a3aff07688 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.170786 May 16 19:09:35.367936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 99/217] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:35 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:09:35.494034 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ebb643e3-952f-47bf-bc7c-4610e03264d2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:35.514207 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ebb643e3-952f-47bf-bc7c-4610e03264d2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1503 microversion: 2.1 time: 0.287197 May 16 19:09:35.514762 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 119/218] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:35 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1503 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:35.797904 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b9ee30c1-30ec-445a-9595-a6f90238fa41 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:35.798503 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b9ee30c1-30ec-445a-9595-a6f90238fa41 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:35.804470 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b9ee30c1-30ec-445a-9595-a6f90238fa41 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:35.804909 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b9ee30c1-30ec-445a-9595-a6f90238fa41 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:35.805691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b9ee30c1-30ec-445a-9595-a6f90238fa41 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:35.806123 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b9ee30c1-30ec-445a-9595-a6f90238fa41 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:35.941683 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b9ee30c1-30ec-445a-9595-a6f90238fa41 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa54a47a738c4b65b13f08921a7f76af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053d1449368243acad7c389435ec357c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:35.949463 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b9ee30c1-30ec-445a-9595-a6f90238fa41 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 200 len: 1313 microversion: 2.1 time: 0.155481 May 16 19:09:35.950055 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 100/219] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:35 2022] GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:36.384254 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1a26d3ca-f6c2-4ea0-aa63-8b71029f4276 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:36.385485 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1a26d3ca-f6c2-4ea0-aa63-8b71029f4276 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:36.391734 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1a26d3ca-f6c2-4ea0-aa63-8b71029f4276 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:36.392184 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1a26d3ca-f6c2-4ea0-aa63-8b71029f4276 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:36.392958 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1a26d3ca-f6c2-4ea0-aa63-8b71029f4276 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:36.393426 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1a26d3ca-f6c2-4ea0-aa63-8b71029f4276 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:36.532222 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-90c7fd75-2e3b-4960-94fb-3573bb47c464 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:36.532986 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-90c7fd75-2e3b-4960-94fb-3573bb47c464 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:36.540098 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-90c7fd75-2e3b-4960-94fb-3573bb47c464 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:36.540901 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-90c7fd75-2e3b-4960-94fb-3573bb47c464 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:36.541964 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-90c7fd75-2e3b-4960-94fb-3573bb47c464 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:36.542613 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-90c7fd75-2e3b-4960-94fb-3573bb47c464 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:36.544790 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1a26d3ca-f6c2-4ea0-aa63-8b71029f4276 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:36.556875 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1a26d3ca-f6c2-4ea0-aa63-8b71029f4276 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.176452 May 16 19:09:36.558141 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 120/220] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:36 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:36.695410 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-90c7fd75-2e3b-4960-94fb-3573bb47c464 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:36.705220 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-90c7fd75-2e3b-4960-94fb-3573bb47c464 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1503 microversion: 2.1 time: 0.177490 May 16 19:09:36.706071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 101/221] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:36 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:09:36.967785 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-7ccbe772-51e8-4a8b-8438-94a754dff8b2 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:36.968591 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-7ccbe772-51e8-4a8b-8438-94a754dff8b2 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:36.975283 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7ccbe772-51e8-4a8b-8438-94a754dff8b2 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:36.975733 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7ccbe772-51e8-4a8b-8438-94a754dff8b2 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:36.976521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7ccbe772-51e8-4a8b-8438-94a754dff8b2 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:36.976952 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7ccbe772-51e8-4a8b-8438-94a754dff8b2 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:37.176168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-7ccbe772-51e8-4a8b-8438-94a754dff8b2 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa54a47a738c4b65b13f08921a7f76af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053d1449368243acad7c389435ec357c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:37.185521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-7ccbe772-51e8-4a8b-8438-94a754dff8b2 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 200 len: 1313 microversion: 2.1 time: 0.221571 May 16 19:09:37.186311 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 121/222] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:36 2022] GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:37.576505 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d8cda82d-4c6b-4443-881e-71c55ce4741f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:37.577165 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d8cda82d-4c6b-4443-881e-71c55ce4741f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:37.583817 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d8cda82d-4c6b-4443-881e-71c55ce4741f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:37.584588 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d8cda82d-4c6b-4443-881e-71c55ce4741f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:37.585633 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d8cda82d-4c6b-4443-881e-71c55ce4741f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:37.586606 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d8cda82d-4c6b-4443-881e-71c55ce4741f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:37.722782 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-bb43213c-8011-4a8e-a5e0-9779f05f568e tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:37.723381 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-bb43213c-8011-4a8e-a5e0-9779f05f568e tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:37.729728 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bb43213c-8011-4a8e-a5e0-9779f05f568e tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:37.730239 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bb43213c-8011-4a8e-a5e0-9779f05f568e tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:37.731199 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bb43213c-8011-4a8e-a5e0-9779f05f568e tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:37.731625 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bb43213c-8011-4a8e-a5e0-9779f05f568e tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:37.795760 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d8cda82d-4c6b-4443-881e-71c55ce4741f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:37.803608 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d8cda82d-4c6b-4443-881e-71c55ce4741f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.231889 May 16 19:09:37.804499 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 102/223] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:37 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:37.935075 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-bb43213c-8011-4a8e-a5e0-9779f05f568e tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:37.943321 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-bb43213c-8011-4a8e-a5e0-9779f05f568e tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1503 microversion: 2.1 time: 0.224494 May 16 19:09:37.954531 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 122/224] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:37 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1503 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:38.202972 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-aea3ed6a-4042-416b-b7d5-7cea4bda3b71 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:38.203718 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-aea3ed6a-4042-416b-b7d5-7cea4bda3b71 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:38.210525 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-aea3ed6a-4042-416b-b7d5-7cea4bda3b71 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:38.211195 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-aea3ed6a-4042-416b-b7d5-7cea4bda3b71 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:38.212310 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-aea3ed6a-4042-416b-b7d5-7cea4bda3b71 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:38.212829 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-aea3ed6a-4042-416b-b7d5-7cea4bda3b71 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:38.419054 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-aea3ed6a-4042-416b-b7d5-7cea4bda3b71 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa54a47a738c4b65b13f08921a7f76af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053d1449368243acad7c389435ec357c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:38.426874 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-aea3ed6a-4042-416b-b7d5-7cea4bda3b71 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 200 len: 1313 microversion: 2.1 time: 0.228219 May 16 19:09:38.427456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 103/225] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:38 2022] GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:38.446961 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-0275c40b-1ad6-45af-bd3e-259bc10ace5f req-2b27b412-1186-450b-8f65-831c43fa7f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a563cc-0788-4993-91c2-7f0976323bfa", "name": "network-vif-deleted", "tag": "9a0b2d2a-1fef-4dea-90a4-8048e7ae84e6"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:38.457129 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-0275c40b-1ad6-45af-bd3e-259bc10ace5f req-2b27b412-1186-450b-8f65-831c43fa7f8f service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:38.457722 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-0275c40b-1ad6-45af-bd3e-259bc10ace5f req-2b27b412-1186-450b-8f65-831c43fa7f8f service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:38.471711 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-0275c40b-1ad6-45af-bd3e-259bc10ace5f req-2b27b412-1186-450b-8f65-831c43fa7f8f service nova] Creating event network-vif-deleted:9a0b2d2a-1fef-4dea-90a4-8048e7ae84e6 for instance 82a563cc-0788-4993-91c2-7f0976323bfa on hv-cinder-76606 May 16 19:09:38.478055 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-0275c40b-1ad6-45af-bd3e-259bc10ace5f req-2b27b412-1186-450b-8f65-831c43fa7f8f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034422 May 16 19:09:38.479044 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 123/226] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:09:38.707799 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-2b2c8bba-5a02-4059-a046-5eb359fc8b71 req-e226b118-08fd-4a44-8c75-a1b94febad45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933c056a-93c1-4871-a304-680d94161112", "name": "network-vif-plugged", "status": "completed", "tag": "984c76d4-84ac-4c34-9a5d-a268247fba7d"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:38.721233 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-2b2c8bba-5a02-4059-a046-5eb359fc8b71 req-e226b118-08fd-4a44-8c75-a1b94febad45 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:38.722263 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-2b2c8bba-5a02-4059-a046-5eb359fc8b71 req-e226b118-08fd-4a44-8c75-a1b94febad45 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:38.735377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-2b2c8bba-5a02-4059-a046-5eb359fc8b71 req-e226b118-08fd-4a44-8c75-a1b94febad45 service nova] Creating event network-vif-plugged:984c76d4-84ac-4c34-9a5d-a268247fba7d for instance 933c056a-93c1-4871-a304-680d94161112 on hv-cinder-76606 May 16 19:09:38.740570 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-2b2c8bba-5a02-4059-a046-5eb359fc8b71 req-e226b118-08fd-4a44-8c75-a1b94febad45 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038114 May 16 19:09:38.741361 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 104/227] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:09:38.821875 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5097880b-db2e-4f61-9c15-cb1831dc36fc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:38.822620 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5097880b-db2e-4f61-9c15-cb1831dc36fc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:38.828816 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5097880b-db2e-4f61-9c15-cb1831dc36fc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:38.829264 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5097880b-db2e-4f61-9c15-cb1831dc36fc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:38.830076 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5097880b-db2e-4f61-9c15-cb1831dc36fc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:38.830560 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5097880b-db2e-4f61-9c15-cb1831dc36fc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:38.961569 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a9b1c03c-88e1-413d-b8e6-80770d5837c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:38.962354 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a9b1c03c-88e1-413d-b8e6-80770d5837c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:38.970628 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a9b1c03c-88e1-413d-b8e6-80770d5837c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:38.971642 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a9b1c03c-88e1-413d-b8e6-80770d5837c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:38.972417 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a9b1c03c-88e1-413d-b8e6-80770d5837c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:38.972845 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a9b1c03c-88e1-413d-b8e6-80770d5837c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:38.975780 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5097880b-db2e-4f61-9c15-cb1831dc36fc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:38.984944 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5097880b-db2e-4f61-9c15-cb1831dc36fc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.167388 May 16 19:09:38.985548 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 124/228] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:38 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:39.005134 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a9b1c03c-88e1-413d-b8e6-80770d5837c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:39.005626 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a9b1c03c-88e1-413d-b8e6-80770d5837c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:39.006073 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-a9b1c03c-88e1-413d-b8e6-80770d5837c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lazy-loading 'fault' on Instance uuid 82a563cc-0788-4993-91c2-7f0976323bfa {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:09:39.059636 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a9b1c03c-88e1-413d-b8e6-80770d5837c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:39.067632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a9b1c03c-88e1-413d-b8e6-80770d5837c3 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 200 len: 1303 microversion: 2.1 time: 0.110811 May 16 19:09:39.068156 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 105/229] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:38 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:09:39.444008 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-736e9b71-35fa-407d-ac21-0812709b2317 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:39.444664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-736e9b71-35fa-407d-ac21-0812709b2317 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:39.451224 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-736e9b71-35fa-407d-ac21-0812709b2317 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:39.451675 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-736e9b71-35fa-407d-ac21-0812709b2317 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:39.452417 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-736e9b71-35fa-407d-ac21-0812709b2317 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:39.452915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-736e9b71-35fa-407d-ac21-0812709b2317 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:39.582660 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-736e9b71-35fa-407d-ac21-0812709b2317 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa54a47a738c4b65b13f08921a7f76af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053d1449368243acad7c389435ec357c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:39.590187 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-736e9b71-35fa-407d-ac21-0812709b2317 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 200 len: 1313 microversion: 2.1 time: 0.150134 May 16 19:09:39.590773 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 125/230] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:39 2022] GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:40.001910 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-22bece28-a285-4c7b-9d7f-ed8c496b0ee0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:40.002528 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-22bece28-a285-4c7b-9d7f-ed8c496b0ee0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:40.009145 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-22bece28-a285-4c7b-9d7f-ed8c496b0ee0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:40.009437 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-22bece28-a285-4c7b-9d7f-ed8c496b0ee0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:40.010993 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-22bece28-a285-4c7b-9d7f-ed8c496b0ee0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:40.011629 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-22bece28-a285-4c7b-9d7f-ed8c496b0ee0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:40.085950 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8e5cf29a-2b1c-442b-b882-0d2021499171 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:40.087405 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8e5cf29a-2b1c-442b-b882-0d2021499171 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 82a563cc-0788-4993-91c2-7f0976323bfa] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:40.095223 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8e5cf29a-2b1c-442b-b882-0d2021499171 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:40.095674 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8e5cf29a-2b1c-442b-b882-0d2021499171 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:40.096465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8e5cf29a-2b1c-442b-b882-0d2021499171 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:40.096933 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8e5cf29a-2b1c-442b-b882-0d2021499171 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:40.112228 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-8e5cf29a-2b1c-442b-b882-0d2021499171 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] HTTP exception thrown: Instance 82a563cc-0788-4993-91c2-7f0976323bfa could not be found. May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8e5cf29a-2b1c-442b-b882-0d2021499171 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Request method failure captured: May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa HTTP/1.1 May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqFRD7RxLbU80EIWA37-0DpxPH1L753HJkhHuIHAupXJ2c564ByRkWg1tG1RN31IqzlK65Vms2n4dOA19Q-UNv1VTfDBDWbdZnHmW7-ac2ldlhWIh4_d6uyHlw1vMSD8VgPYAA9Tpltv4UV6SGAe1_OGfUVucKC-H4m41NK4LzZsRUs May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: f7b9188e991a4a7bb57c8a5beb3fb278 May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-VolumesActionsTest-1837558772 May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:09:40.117977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:09:40.119243 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f7b9188e991a4a7bb57c8a5beb3fb278"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f7b9188e991a4a7bb57c8a5beb3fb278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/f7b9188e991a4a7bb57c8a5beb3fb278"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_f7b9188e991a4a7bb57c8a5beb3fb278"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:09:40.119243 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-VolumesActionsTest-1837558772 May 16 19:09:40.119243 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: f7b9188e991a4a7bb57c8a5beb3fb278 May 16 19:09:40.119243 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-VolumesActionsTest-1837558772 May 16 19:09:40.119243 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-VolumesActionsTest-1837558772-project May 16 19:09:40.119243 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:09:40.119243 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:09:40.119243 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: c8ac79259d304d589aa1e529849bfcbe May 16 19:09:40.119243 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-VolumesActionsTest-1837558772-project May 16 19:09:40.119243 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:09:40.119243 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance 82a563cc-0788-4993-91c2-7f0976323bfa could not be found. May 16 19:09:40.119243 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': '82a563cc-0788-4993-91c2-7f0976323bfa'} May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a563cc-0788-4993-91c2-7f0976323bfa could not be found. May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:09:40.119920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a563cc-0788-4993-91c2-7f0976323bfa could not be found. May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a563cc-0788-4993-91c2-7f0976323bfa could not be found. May 16 19:09:40.120990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:09:40.121974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8e5cf29a-2b1c-442b-b882-0d2021499171 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Returning 404 to user: Instance 82a563cc-0788-4993-91c2-7f0976323bfa could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:09:40.121974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8e5cf29a-2b1c-442b-b882-0d2021499171 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa" status: 404 len: 111 microversion: 2.1 time: 0.038536 May 16 19:09:40.132928 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 126/231] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:40 2022] GET /compute/v2.1/servers/82a563cc-0788-4993-91c2-7f0976323bfa => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:09:40.173147 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-22bece28-a285-4c7b-9d7f-ed8c496b0ee0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:40.181161 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-22bece28-a285-4c7b-9d7f-ed8c496b0ee0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.183134 May 16 19:09:40.182340 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 106/232] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:39 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:40.224542 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-662cfe87-5748-4a3e-960e-cdea393338e1 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-847712254", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452", "networks": [{"uuid": "59ff3965-e68d-4359-9120-68276006b27c"}]}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:40.275227 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.network.neutron [None req-662cfe87-5748-4a3e-960e-cdea393338e1 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] validate_networks() for [('59ff3965-e68d-4359-9120-68276006b27c', None, None, None, None, None)] {{(pid=117275) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:09:40.607077 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a07ebc49-15f5-448d-89b0-842e37c26c7b tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:40.607763 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a07ebc49-15f5-448d-89b0-842e37c26c7b tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:40.614344 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a07ebc49-15f5-448d-89b0-842e37c26c7b tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:40.614875 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a07ebc49-15f5-448d-89b0-842e37c26c7b tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:40.615988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a07ebc49-15f5-448d-89b0-842e37c26c7b tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:40.616597 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a07ebc49-15f5-448d-89b0-842e37c26c7b tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:40.620186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-662cfe87-5748-4a3e-960e-cdea393338e1 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Flavor limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:09:40.621051 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-662cfe87-5748-4a3e-960e-cdea393338e1 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Image limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:09:40.621819 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-662cfe87-5748-4a3e-960e-cdea393338e1 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Flavor pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:09:40.622773 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-662cfe87-5748-4a3e-960e-cdea393338e1 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Image pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:09:40.623189 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-662cfe87-5748-4a3e-960e-cdea393338e1 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:09:40.635096 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-662cfe87-5748-4a3e-960e-cdea393338e1 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:40.635548 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-662cfe87-5748-4a3e-960e-cdea393338e1 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:40.636591 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-662cfe87-5748-4a3e-960e-cdea393338e1 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:40.637244 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-662cfe87-5748-4a3e-960e-cdea393338e1 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:40.655125 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-662cfe87-5748-4a3e-960e-cdea393338e1 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Getting quotas for project f7b9188e991a4a7bb57c8a5beb3fb278. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:09:40.663143 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-662cfe87-5748-4a3e-960e-cdea393338e1 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Getting quotas for user c8ac79259d304d589aa1e529849bfcbe and project f7b9188e991a4a7bb57c8a5beb3fb278. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:09:40.671702 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-662cfe87-5748-4a3e-960e-cdea393338e1 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Going to run 1 instances... {{(pid=117275) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:09:40.674316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-662cfe87-5748-4a3e-960e-cdea393338e1 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:09:40.723500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-662cfe87-5748-4a3e-960e-cdea393338e1 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503022 May 16 19:09:40.726195 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 127/233] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:09:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:09:40.736326 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-16f09f56-c17f-44b4-81bd-9886c0bdd70c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:40.737426 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-16f09f56-c17f-44b4-81bd-9886c0bdd70c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:40.810854 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-16f09f56-c17f-44b4-81bd-9886c0bdd70c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:40.813334 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a07ebc49-15f5-448d-89b0-842e37c26c7b tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa54a47a738c4b65b13f08921a7f76af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053d1449368243acad7c389435ec357c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:40.830899 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-16f09f56-c17f-44b4-81bd-9886c0bdd70c tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 200 len: 1213 microversion: 2.1 time: 0.099074 May 16 19:09:40.835261 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a07ebc49-15f5-448d-89b0-842e37c26c7b tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 200 len: 1313 microversion: 2.1 time: 0.232225 May 16 19:09:40.837319 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 128/234] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:40 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:40.838457 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 107/235] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:40 2022] GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:41.198302 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5b783678-0371-4c56-83b3-2e0d360fee7a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:41.199001 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5b783678-0371-4c56-83b3-2e0d360fee7a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:41.205205 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5b783678-0371-4c56-83b3-2e0d360fee7a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:41.205675 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5b783678-0371-4c56-83b3-2e0d360fee7a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:41.206430 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5b783678-0371-4c56-83b3-2e0d360fee7a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:41.206854 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5b783678-0371-4c56-83b3-2e0d360fee7a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:41.349308 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5b783678-0371-4c56-83b3-2e0d360fee7a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:41.359796 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5b783678-0371-4c56-83b3-2e0d360fee7a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.163552 May 16 19:09:41.360841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 129/236] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:41 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:41.852683 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-15711e55-baa1-4212-bbe0-9cd110d692a7 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:41.853269 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-15711e55-baa1-4212-bbe0-9cd110d692a7 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:41.854564 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c8781358-8fd3-4f4c-8ee6-c262fcf18ccb tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:41.855310 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c8781358-8fd3-4f4c-8ee6-c262fcf18ccb tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:41.860245 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-15711e55-baa1-4212-bbe0-9cd110d692a7 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:41.860672 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-15711e55-baa1-4212-bbe0-9cd110d692a7 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:41.861321 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c8781358-8fd3-4f4c-8ee6-c262fcf18ccb tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:41.861426 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-15711e55-baa1-4212-bbe0-9cd110d692a7 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:41.861785 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c8781358-8fd3-4f4c-8ee6-c262fcf18ccb tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:41.861886 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-15711e55-baa1-4212-bbe0-9cd110d692a7 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:41.863625 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c8781358-8fd3-4f4c-8ee6-c262fcf18ccb tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:41.863625 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c8781358-8fd3-4f4c-8ee6-c262fcf18ccb tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:41.932300 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-15711e55-baa1-4212-bbe0-9cd110d692a7 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:41.940875 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-15711e55-baa1-4212-bbe0-9cd110d692a7 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 200 len: 1265 microversion: 2.1 time: 0.092293 May 16 19:09:41.941809 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 108/237] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:41 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:42.000864 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c8781358-8fd3-4f4c-8ee6-c262fcf18ccb tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa54a47a738c4b65b13f08921a7f76af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053d1449368243acad7c389435ec357c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:42.008709 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c8781358-8fd3-4f4c-8ee6-c262fcf18ccb tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 200 len: 1463 microversion: 2.1 time: 0.158117 May 16 19:09:42.009487 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 130/238] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:41 2022] GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:42.050727 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f613263e-6c73-4dde-a271-a0ef2926e3b1 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:42.051357 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f613263e-6c73-4dde-a271-a0ef2926e3b1 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:42.057758 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f613263e-6c73-4dde-a271-a0ef2926e3b1 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:42.058510 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f613263e-6c73-4dde-a271-a0ef2926e3b1 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:42.061951 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f613263e-6c73-4dde-a271-a0ef2926e3b1 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:42.062513 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f613263e-6c73-4dde-a271-a0ef2926e3b1 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:42.092215 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f613263e-6c73-4dde-a271-a0ef2926e3b1 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Going to try to terminate instance {{(pid=117274) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:09:42.187776 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f613263e-6c73-4dde-a271-a0ef2926e3b1 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "DELETE /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 204 len: 0 microversion: 2.1 time: 0.140357 May 16 19:09:42.188723 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 109/239] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:09:42 2022] DELETE /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 19:09:42.196945 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d99fc98d-bcdb-435c-95ac-a68c498bcc88 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:42.197804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d99fc98d-bcdb-435c-95ac-a68c498bcc88 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:42.206947 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d99fc98d-bcdb-435c-95ac-a68c498bcc88 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:42.207658 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d99fc98d-bcdb-435c-95ac-a68c498bcc88 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:42.208538 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d99fc98d-bcdb-435c-95ac-a68c498bcc88 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:42.209037 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d99fc98d-bcdb-435c-95ac-a68c498bcc88 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:42.378172 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-6bdab13a-4e4c-40bb-ab68-76d7f421fd14 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:42.378842 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-6bdab13a-4e4c-40bb-ab68-76d7f421fd14 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:42.385104 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6bdab13a-4e4c-40bb-ab68-76d7f421fd14 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:42.385576 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6bdab13a-4e4c-40bb-ab68-76d7f421fd14 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:42.386344 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6bdab13a-4e4c-40bb-ab68-76d7f421fd14 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:42.387085 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6bdab13a-4e4c-40bb-ab68-76d7f421fd14 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:42.400866 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d99fc98d-bcdb-435c-95ac-a68c498bcc88 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa54a47a738c4b65b13f08921a7f76af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053d1449368243acad7c389435ec357c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:42.412566 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d99fc98d-bcdb-435c-95ac-a68c498bcc88 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 200 len: 1469 microversion: 2.1 time: 0.219431 May 16 19:09:42.413309 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 131/240] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:42 2022] GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 1469 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:09:42.532045 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-6bdab13a-4e4c-40bb-ab68-76d7f421fd14 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:42.548283 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-6bdab13a-4e4c-40bb-ab68-76d7f421fd14 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.174427 May 16 19:09:42.548712 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 110/241] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:42 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:42.959115 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c3149748-9364-4491-ac53-d6034ab0bc18 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:42.959916 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c3149748-9364-4491-ac53-d6034ab0bc18 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:42.966395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c3149748-9364-4491-ac53-d6034ab0bc18 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:42.966844 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c3149748-9364-4491-ac53-d6034ab0bc18 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:42.967617 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c3149748-9364-4491-ac53-d6034ab0bc18 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:42.968126 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c3149748-9364-4491-ac53-d6034ab0bc18 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:43.103778 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c3149748-9364-4491-ac53-d6034ab0bc18 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:43.113199 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c3149748-9364-4491-ac53-d6034ab0bc18 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 200 len: 1313 microversion: 2.1 time: 0.158629 May 16 19:09:43.113846 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 132/242] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:42 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:43.430817 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-50fe193a-ac04-4530-b322-a69729c8017a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:43.431397 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-50fe193a-ac04-4530-b322-a69729c8017a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:43.438470 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-50fe193a-ac04-4530-b322-a69729c8017a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:43.438912 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-50fe193a-ac04-4530-b322-a69729c8017a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:43.439668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-50fe193a-ac04-4530-b322-a69729c8017a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:43.440087 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-50fe193a-ac04-4530-b322-a69729c8017a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:43.564501 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d7299d8f-2b66-4731-8b9f-8ea313e49685 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:43.565107 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d7299d8f-2b66-4731-8b9f-8ea313e49685 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:43.571402 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d7299d8f-2b66-4731-8b9f-8ea313e49685 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:43.571820 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d7299d8f-2b66-4731-8b9f-8ea313e49685 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:43.572589 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d7299d8f-2b66-4731-8b9f-8ea313e49685 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:43.573019 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d7299d8f-2b66-4731-8b9f-8ea313e49685 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:43.577217 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-50fe193a-ac04-4530-b322-a69729c8017a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa54a47a738c4b65b13f08921a7f76af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053d1449368243acad7c389435ec357c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:43.586145 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-50fe193a-ac04-4530-b322-a69729c8017a tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 200 len: 1469 microversion: 2.1 time: 0.159133 May 16 19:09:43.586771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 111/243] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:43 2022] GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:43.708011 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d7299d8f-2b66-4731-8b9f-8ea313e49685 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:43.715822 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d7299d8f-2b66-4731-8b9f-8ea313e49685 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.155421 May 16 19:09:43.716388 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 133/244] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:43 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:44.131380 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-421bbb88-c69b-4377-90f1-ed5b18c79c1a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:44.132174 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-421bbb88-c69b-4377-90f1-ed5b18c79c1a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:44.138577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-421bbb88-c69b-4377-90f1-ed5b18c79c1a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:44.139032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-421bbb88-c69b-4377-90f1-ed5b18c79c1a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:44.139966 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-421bbb88-c69b-4377-90f1-ed5b18c79c1a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:44.140405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-421bbb88-c69b-4377-90f1-ed5b18c79c1a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:44.279341 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-421bbb88-c69b-4377-90f1-ed5b18c79c1a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:44.287127 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-421bbb88-c69b-4377-90f1-ed5b18c79c1a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 200 len: 1313 microversion: 2.1 time: 0.160491 May 16 19:09:44.287705 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 112/245] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:44 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:44.605502 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-603236d8-56c8-47cb-bd19-22b56fb70a26 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:44.606206 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-603236d8-56c8-47cb-bd19-22b56fb70a26 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:44.613421 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-603236d8-56c8-47cb-bd19-22b56fb70a26 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:44.614028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-603236d8-56c8-47cb-bd19-22b56fb70a26 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:44.614859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-603236d8-56c8-47cb-bd19-22b56fb70a26 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:44.615290 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-603236d8-56c8-47cb-bd19-22b56fb70a26 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:44.631658 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-c6a41dc0-4103-4373-a66f-fcbde9fea8ed req-a3922e0a-5c37-4b23-bf80-f1162adab0cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c97056-d30a-48e1-b7de-6d4189928110", "tag": "82b86d38-e8bf-48de-b2c3-0b8bd5ac4c75"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:44.644625 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-c6a41dc0-4103-4373-a66f-fcbde9fea8ed req-a3922e0a-5c37-4b23-bf80-f1162adab0cc service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:44.645377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-c6a41dc0-4103-4373-a66f-fcbde9fea8ed req-a3922e0a-5c37-4b23-bf80-f1162adab0cc service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:44.657692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-c6a41dc0-4103-4373-a66f-fcbde9fea8ed req-a3922e0a-5c37-4b23-bf80-f1162adab0cc service nova] Creating event network-changed:82b86d38-e8bf-48de-b2c3-0b8bd5ac4c75 for instance 25c97056-d30a-48e1-b7de-6d4189928110 on hv-cinder-76606 May 16 19:09:44.662570 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-c6a41dc0-4103-4373-a66f-fcbde9fea8ed req-a3922e0a-5c37-4b23-bf80-f1162adab0cc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037491 May 16 19:09:44.663160 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 113/246] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:09:44.733031 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b49e5224-b9ec-40d0-a14e-2aab93d52b52 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:44.733896 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b49e5224-b9ec-40d0-a14e-2aab93d52b52 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:44.740261 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b49e5224-b9ec-40d0-a14e-2aab93d52b52 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:44.741019 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b49e5224-b9ec-40d0-a14e-2aab93d52b52 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:44.742138 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b49e5224-b9ec-40d0-a14e-2aab93d52b52 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:44.742813 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b49e5224-b9ec-40d0-a14e-2aab93d52b52 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:44.876437 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b49e5224-b9ec-40d0-a14e-2aab93d52b52 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:44.885517 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b49e5224-b9ec-40d0-a14e-2aab93d52b52 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.156002 May 16 19:09:44.906025 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 114/247] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:44 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:09:44.961894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-603236d8-56c8-47cb-bd19-22b56fb70a26 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa54a47a738c4b65b13f08921a7f76af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053d1449368243acad7c389435ec357c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:44.980457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-603236d8-56c8-47cb-bd19-22b56fb70a26 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 200 len: 1469 microversion: 2.1 time: 0.377620 May 16 19:09:44.981125 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 134/248] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:44 2022] GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 1469 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:45.303566 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-56e854a0-8caa-4878-a34b-ed8a3cd8f12f tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:45.304179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-56e854a0-8caa-4878-a34b-ed8a3cd8f12f tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:45.311112 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-56e854a0-8caa-4878-a34b-ed8a3cd8f12f tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:45.311563 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-56e854a0-8caa-4878-a34b-ed8a3cd8f12f tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:45.312367 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-56e854a0-8caa-4878-a34b-ed8a3cd8f12f tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:45.312791 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-56e854a0-8caa-4878-a34b-ed8a3cd8f12f tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:45.456361 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-56e854a0-8caa-4878-a34b-ed8a3cd8f12f tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:45.463772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-56e854a0-8caa-4878-a34b-ed8a3cd8f12f tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 200 len: 1313 microversion: 2.1 time: 0.164246 May 16 19:09:45.464349 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 115/249] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:45 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:45.905629 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d9f4bf7a-93af-48ab-b988-5dece27531ac tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:45.906915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d9f4bf7a-93af-48ab-b988-5dece27531ac tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:45.912897 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d9f4bf7a-93af-48ab-b988-5dece27531ac tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:45.913338 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d9f4bf7a-93af-48ab-b988-5dece27531ac tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:45.914185 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d9f4bf7a-93af-48ab-b988-5dece27531ac tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:45.914614 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d9f4bf7a-93af-48ab-b988-5dece27531ac tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:46.000864 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-62dd395e-6df1-4dce-8482-5993c4a7bc56 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:46.001483 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-62dd395e-6df1-4dce-8482-5993c4a7bc56 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:46.008020 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-62dd395e-6df1-4dce-8482-5993c4a7bc56 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:46.008466 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-62dd395e-6df1-4dce-8482-5993c4a7bc56 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:46.009243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-62dd395e-6df1-4dce-8482-5993c4a7bc56 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:46.009719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-62dd395e-6df1-4dce-8482-5993c4a7bc56 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:46.042903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-62dd395e-6df1-4dce-8482-5993c4a7bc56 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:46.043351 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-62dd395e-6df1-4dce-8482-5993c4a7bc56 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:46.043957 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-62dd395e-6df1-4dce-8482-5993c4a7bc56 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lazy-loading 'fault' on Instance uuid 933c056a-93c1-4871-a304-680d94161112 {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:09:46.056167 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d9f4bf7a-93af-48ab-b988-5dece27531ac tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:46.065980 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d9f4bf7a-93af-48ab-b988-5dece27531ac tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.166418 May 16 19:09:46.068093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 135/250] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:45 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:46.085273 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-62dd395e-6df1-4dce-8482-5993c4a7bc56 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa54a47a738c4b65b13f08921a7f76af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053d1449368243acad7c389435ec357c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:46.093227 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-62dd395e-6df1-4dce-8482-5993c4a7bc56 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 200 len: 1303 microversion: 2.1 time: 0.096599 May 16 19:09:46.093815 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 116/251] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:45 2022] GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:46.481050 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5ecf7e27-9830-4342-9271-2695df99ed6a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:46.481708 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5ecf7e27-9830-4342-9271-2695df99ed6a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:46.488268 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5ecf7e27-9830-4342-9271-2695df99ed6a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:46.488709 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5ecf7e27-9830-4342-9271-2695df99ed6a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:46.489481 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5ecf7e27-9830-4342-9271-2695df99ed6a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:46.489951 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5ecf7e27-9830-4342-9271-2695df99ed6a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:46.631140 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5ecf7e27-9830-4342-9271-2695df99ed6a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:46.639084 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5ecf7e27-9830-4342-9271-2695df99ed6a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 200 len: 1313 microversion: 2.1 time: 0.162027 May 16 19:09:46.639637 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 136/252] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:46 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:46.692396 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-05ccfbff-f7b0-477e-88a6-c2f52d994fa1 req-652bbc87-1258-43c1-bece-03d5152ebc91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933c056a-93c1-4871-a304-680d94161112", "name": "network-vif-deleted", "tag": "984c76d4-84ac-4c34-9a5d-a268247fba7d"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:46.700666 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-05ccfbff-f7b0-477e-88a6-c2f52d994fa1 req-652bbc87-1258-43c1-bece-03d5152ebc91 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:46.701103 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-05ccfbff-f7b0-477e-88a6-c2f52d994fa1 req-652bbc87-1258-43c1-bece-03d5152ebc91 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:46.712386 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-05ccfbff-f7b0-477e-88a6-c2f52d994fa1 req-652bbc87-1258-43c1-bece-03d5152ebc91 service nova] Creating event network-vif-deleted:984c76d4-84ac-4c34-9a5d-a268247fba7d for instance 933c056a-93c1-4871-a304-680d94161112 on hv-cinder-76606 May 16 19:09:46.717506 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-05ccfbff-f7b0-477e-88a6-c2f52d994fa1 req-652bbc87-1258-43c1-bece-03d5152ebc91 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029493 May 16 19:09:46.718176 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 117/253] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:09:47.084334 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e253ce97-9800-4e41-96cb-60b8f742869f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:47.085237 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e253ce97-9800-4e41-96cb-60b8f742869f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:47.092028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e253ce97-9800-4e41-96cb-60b8f742869f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:47.092558 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e253ce97-9800-4e41-96cb-60b8f742869f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:47.093364 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e253ce97-9800-4e41-96cb-60b8f742869f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:47.093815 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e253ce97-9800-4e41-96cb-60b8f742869f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:47.111561 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-82b3ee95-864d-4c10-8259-ebad38eb23a8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:47.113011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-82b3ee95-864d-4c10-8259-ebad38eb23a8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] [instance: 933c056a-93c1-4871-a304-680d94161112] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:47.124856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-82b3ee95-864d-4c10-8259-ebad38eb23a8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:47.125636 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-82b3ee95-864d-4c10-8259-ebad38eb23a8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:47.126961 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-82b3ee95-864d-4c10-8259-ebad38eb23a8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:47.127588 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-82b3ee95-864d-4c10-8259-ebad38eb23a8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:47.146724 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-82b3ee95-864d-4c10-8259-ebad38eb23a8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] HTTP exception thrown: Instance 933c056a-93c1-4871-a304-680d94161112 could not be found. May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-82b3ee95-864d-4c10-8259-ebad38eb23a8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Request method failure captured: May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 HTTP/1.1 May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqFniVYis_q57ylLJsz--dqAYfKQ2OQW1TrATpTgb6N8fdXsmQEhrp5mHvuv_3MJw55hsPMg_-aeVziPpS5aQtYmKHofX5uX51l6FRLZ4z6jZhYID7fvrZfbbsD1DZUqFzWIos61QwYKc383BY8D9g4CWYP5eG4cukKT625hgkJcmMY May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: 053d1449368243acad7c389435ec357c May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-VolumesNegativeTest-72857569 May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:09:47.153577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:09:47.155083 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/053d1449368243acad7c389435ec357c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/053d1449368243acad7c389435ec357c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/053d1449368243acad7c389435ec357c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_053d1449368243acad7c389435ec357c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:09:47.155083 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-VolumesNegativeTest-72857569 May 16 19:09:47.155083 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: 053d1449368243acad7c389435ec357c May 16 19:09:47.155083 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-VolumesNegativeTest-72857569 May 16 19:09:47.155083 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-VolumesNegativeTest-72857569-project May 16 19:09:47.155083 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:09:47.155083 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:09:47.155083 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: fa54a47a738c4b65b13f08921a7f76af May 16 19:09:47.155083 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-VolumesNegativeTest-72857569-project May 16 19:09:47.155083 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:09:47.155083 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance 933c056a-93c1-4871-a304-680d94161112 could not be found. May 16 19:09:47.155083 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': '933c056a-93c1-4871-a304-680d94161112'} May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 933c056a-93c1-4871-a304-680d94161112 could not be found. May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:09:47.156111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 933c056a-93c1-4871-a304-680d94161112 could not be found. May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 933c056a-93c1-4871-a304-680d94161112 could not be found. May 16 19:09:47.157792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:47.158964 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-82b3ee95-864d-4c10-8259-ebad38eb23a8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] Returning 404 to user: Instance 933c056a-93c1-4871-a304-680d94161112 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:09:47.158964 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-82b3ee95-864d-4c10-8259-ebad38eb23a8 tempest-VolumesNegativeTest-72857569 tempest-VolumesNegativeTest-72857569-project] 10.222.0.24 "GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112" status: 404 len: 111 microversion: 2.1 time: 0.049607 May 16 19:09:47.166462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 118/254] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:47 2022] GET /compute/v2.1/servers/933c056a-93c1-4871-a304-680d94161112 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:09:47.320721 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e253ce97-9800-4e41-96cb-60b8f742869f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:47.328282 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e253ce97-9800-4e41-96cb-60b8f742869f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.247878 May 16 19:09:47.329272 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 137/255] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:47 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:47.657546 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-add5ffe4-2615-45fa-b8d0-5923eba1e519 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:47.658184 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-add5ffe4-2615-45fa-b8d0-5923eba1e519 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:47.664427 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-add5ffe4-2615-45fa-b8d0-5923eba1e519 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:47.664968 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-add5ffe4-2615-45fa-b8d0-5923eba1e519 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:47.666180 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-add5ffe4-2615-45fa-b8d0-5923eba1e519 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:47.666623 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-add5ffe4-2615-45fa-b8d0-5923eba1e519 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:47.827241 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-add5ffe4-2615-45fa-b8d0-5923eba1e519 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:47.835186 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-add5ffe4-2615-45fa-b8d0-5923eba1e519 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 200 len: 1313 microversion: 2.1 time: 0.183080 May 16 19:09:47.836064 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 119/256] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:47 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:48.345037 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f25f5704-a36e-47d5-aaf3-fa29849d52e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:48.345680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f25f5704-a36e-47d5-aaf3-fa29849d52e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:48.351790 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f25f5704-a36e-47d5-aaf3-fa29849d52e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:48.352355 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f25f5704-a36e-47d5-aaf3-fa29849d52e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:48.353152 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f25f5704-a36e-47d5-aaf3-fa29849d52e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:48.353602 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f25f5704-a36e-47d5-aaf3-fa29849d52e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:48.500478 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f25f5704-a36e-47d5-aaf3-fa29849d52e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:48.508714 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f25f5704-a36e-47d5-aaf3-fa29849d52e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.167539 May 16 19:09:48.509299 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 138/257] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:48 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:48.853632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ed44fd2e-77c2-4e58-8b9d-b2bc5085974f tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:48.855475 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ed44fd2e-77c2-4e58-8b9d-b2bc5085974f tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:48.875292 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ed44fd2e-77c2-4e58-8b9d-b2bc5085974f tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:48.877988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ed44fd2e-77c2-4e58-8b9d-b2bc5085974f tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:48.879945 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ed44fd2e-77c2-4e58-8b9d-b2bc5085974f tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:48.881151 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ed44fd2e-77c2-4e58-8b9d-b2bc5085974f tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:49.033169 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ed44fd2e-77c2-4e58-8b9d-b2bc5085974f tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:49.040680 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ed44fd2e-77c2-4e58-8b9d-b2bc5085974f tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 200 len: 1313 microversion: 2.1 time: 0.193219 May 16 19:09:49.041254 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 120/258] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:48 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:49.526033 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-bf213b11-0a94-4f52-b285-efb0cc9f3758 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:49.526755 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-bf213b11-0a94-4f52-b285-efb0cc9f3758 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:49.533978 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bf213b11-0a94-4f52-b285-efb0cc9f3758 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:49.534433 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bf213b11-0a94-4f52-b285-efb0cc9f3758 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:49.535202 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bf213b11-0a94-4f52-b285-efb0cc9f3758 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:49.535663 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bf213b11-0a94-4f52-b285-efb0cc9f3758 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:49.693788 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-bf213b11-0a94-4f52-b285-efb0cc9f3758 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:49.702320 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-bf213b11-0a94-4f52-b285-efb0cc9f3758 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.180430 May 16 19:09:49.702911 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 139/259] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:49 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:50.057318 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-42c8adf4-fd11-4537-8f66-156ba78a3a7d tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:50.059138 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-42c8adf4-fd11-4537-8f66-156ba78a3a7d tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:50.065640 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-42c8adf4-fd11-4537-8f66-156ba78a3a7d tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:50.066111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-42c8adf4-fd11-4537-8f66-156ba78a3a7d tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:50.066862 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-42c8adf4-fd11-4537-8f66-156ba78a3a7d tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:50.067896 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-42c8adf4-fd11-4537-8f66-156ba78a3a7d tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:50.423366 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-42c8adf4-fd11-4537-8f66-156ba78a3a7d tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:50.431092 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-42c8adf4-fd11-4537-8f66-156ba78a3a7d tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 200 len: 1313 microversion: 2.1 time: 0.377648 May 16 19:09:50.432129 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 121/260] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:50 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:50.720504 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0db125a1-50ac-41ef-80a0-89cd0eab000d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:50.721712 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0db125a1-50ac-41ef-80a0-89cd0eab000d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:50.728014 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0db125a1-50ac-41ef-80a0-89cd0eab000d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:50.728456 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0db125a1-50ac-41ef-80a0-89cd0eab000d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:50.729385 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0db125a1-50ac-41ef-80a0-89cd0eab000d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:50.729920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0db125a1-50ac-41ef-80a0-89cd0eab000d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:50.814392 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-d1bab457-7901-4d7f-876e-3ad8e608e558 req-9ff222b7-50fd-4c71-83ec-e6dab1a40e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c97056-d30a-48e1-b7de-6d4189928110", "name": "network-vif-plugged", "status": "completed", "tag": "82b86d38-e8bf-48de-b2c3-0b8bd5ac4c75"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:50.824974 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-d1bab457-7901-4d7f-876e-3ad8e608e558 req-9ff222b7-50fd-4c71-83ec-e6dab1a40e79 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:50.825946 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-d1bab457-7901-4d7f-876e-3ad8e608e558 req-9ff222b7-50fd-4c71-83ec-e6dab1a40e79 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:50.842012 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-d1bab457-7901-4d7f-876e-3ad8e608e558 req-9ff222b7-50fd-4c71-83ec-e6dab1a40e79 service nova] Creating event network-vif-plugged:82b86d38-e8bf-48de-b2c3-0b8bd5ac4c75 for instance 25c97056-d30a-48e1-b7de-6d4189928110 on hv-cinder-76606 May 16 19:09:50.848966 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-d1bab457-7901-4d7f-876e-3ad8e608e558 req-9ff222b7-50fd-4c71-83ec-e6dab1a40e79 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039128 May 16 19:09:50.850068 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 122/261] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:09:50.937038 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0db125a1-50ac-41ef-80a0-89cd0eab000d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:50.947086 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0db125a1-50ac-41ef-80a0-89cd0eab000d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.231372 May 16 19:09:50.956968 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 140/262] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:50 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:09:51.449860 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c5e184d6-eee9-4ac3-8ce0-12a7d942704a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:51.450562 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c5e184d6-eee9-4ac3-8ce0-12a7d942704a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:51.456914 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c5e184d6-eee9-4ac3-8ce0-12a7d942704a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:51.457385 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c5e184d6-eee9-4ac3-8ce0-12a7d942704a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:51.458254 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c5e184d6-eee9-4ac3-8ce0-12a7d942704a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:51.458684 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c5e184d6-eee9-4ac3-8ce0-12a7d942704a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:51.592782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c5e184d6-eee9-4ac3-8ce0-12a7d942704a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:51.600478 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c5e184d6-eee9-4ac3-8ce0-12a7d942704a tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 200 len: 1313 microversion: 2.1 time: 0.155468 May 16 19:09:51.601127 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 123/263] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:51 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:51.964930 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-59f12934-65c6-4cf0-b051-b53f22d69cb4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:51.965565 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-59f12934-65c6-4cf0-b051-b53f22d69cb4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:51.972487 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-59f12934-65c6-4cf0-b051-b53f22d69cb4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:51.973442 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-59f12934-65c6-4cf0-b051-b53f22d69cb4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:51.974659 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-59f12934-65c6-4cf0-b051-b53f22d69cb4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:51.975157 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-59f12934-65c6-4cf0-b051-b53f22d69cb4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:52.165115 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-59f12934-65c6-4cf0-b051-b53f22d69cb4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:52.173423 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-59f12934-65c6-4cf0-b051-b53f22d69cb4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.212815 May 16 19:09:52.174042 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 141/264] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:51 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:52.622138 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-424adee1-e5f6-490a-8eca-bdbd927080db tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:52.622794 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-424adee1-e5f6-490a-8eca-bdbd927080db tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:52.633898 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-424adee1-e5f6-490a-8eca-bdbd927080db tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:52.634350 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-424adee1-e5f6-490a-8eca-bdbd927080db tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:52.635535 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-424adee1-e5f6-490a-8eca-bdbd927080db tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:52.635971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-424adee1-e5f6-490a-8eca-bdbd927080db tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:52.789361 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-424adee1-e5f6-490a-8eca-bdbd927080db tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:52.797581 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-424adee1-e5f6-490a-8eca-bdbd927080db tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 200 len: 1497 microversion: 2.1 time: 0.183356 May 16 19:09:52.798188 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 124/265] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:52 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:53.190603 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-dbb71885-ec99-475d-8bf4-a97af8ed0871 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:53.191285 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-dbb71885-ec99-475d-8bf4-a97af8ed0871 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:53.197295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dbb71885-ec99-475d-8bf4-a97af8ed0871 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:53.197777 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dbb71885-ec99-475d-8bf4-a97af8ed0871 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:53.198547 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dbb71885-ec99-475d-8bf4-a97af8ed0871 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:53.199024 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dbb71885-ec99-475d-8bf4-a97af8ed0871 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:53.361874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-dbb71885-ec99-475d-8bf4-a97af8ed0871 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:53.372498 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-dbb71885-ec99-475d-8bf4-a97af8ed0871 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.185586 May 16 19:09:53.373608 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 142/266] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:53 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:53.413975 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-fae5785b-063a-47e5-a1f2-a55f2f382a20 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:53.414485 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-fae5785b-063a-47e5-a1f2-a55f2f382a20 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:53.420596 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fae5785b-063a-47e5-a1f2-a55f2f382a20 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:53.421046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fae5785b-063a-47e5-a1f2-a55f2f382a20 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:53.421890 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fae5785b-063a-47e5-a1f2-a55f2f382a20 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:53.422388 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fae5785b-063a-47e5-a1f2-a55f2f382a20 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:53.447366 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-fae5785b-063a-47e5-a1f2-a55f2f382a20 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Going to try to terminate instance {{(pid=117274) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:09:53.544304 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-fae5785b-063a-47e5-a1f2-a55f2f382a20 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "DELETE /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 204 len: 0 microversion: 2.1 time: 0.134086 May 16 19:09:53.545256 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 125/267] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:09:53 2022] DELETE /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 19:09:53.554148 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5e51a84a-8b8b-4a9a-b630-17e923d0d530 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:53.554765 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5e51a84a-8b8b-4a9a-b630-17e923d0d530 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:53.561161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5e51a84a-8b8b-4a9a-b630-17e923d0d530 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:53.561676 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5e51a84a-8b8b-4a9a-b630-17e923d0d530 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:53.562504 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5e51a84a-8b8b-4a9a-b630-17e923d0d530 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:53.562942 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5e51a84a-8b8b-4a9a-b630-17e923d0d530 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:53.755100 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5e51a84a-8b8b-4a9a-b630-17e923d0d530 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:53.763033 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5e51a84a-8b8b-4a9a-b630-17e923d0d530 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 200 len: 1503 microversion: 2.1 time: 0.213106 May 16 19:09:53.763679 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 143/268] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:53 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:54.390721 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-eafaa818-6403-4052-80fc-cba789cce8f2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:54.392098 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-eafaa818-6403-4052-80fc-cba789cce8f2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:54.399133 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-eafaa818-6403-4052-80fc-cba789cce8f2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:54.399771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-eafaa818-6403-4052-80fc-cba789cce8f2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:54.400715 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-eafaa818-6403-4052-80fc-cba789cce8f2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:54.401286 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-eafaa818-6403-4052-80fc-cba789cce8f2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:54.671529 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-eafaa818-6403-4052-80fc-cba789cce8f2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:54.686828 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-eafaa818-6403-4052-80fc-cba789cce8f2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.299421 May 16 19:09:54.687508 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 126/269] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:54 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:54.781347 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-670a7c6a-1125-49ca-8059-b7d693fa06b2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:54.783350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-670a7c6a-1125-49ca-8059-b7d693fa06b2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:54.789917 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-670a7c6a-1125-49ca-8059-b7d693fa06b2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:54.790258 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-670a7c6a-1125-49ca-8059-b7d693fa06b2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:54.791091 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-670a7c6a-1125-49ca-8059-b7d693fa06b2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:54.791622 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-670a7c6a-1125-49ca-8059-b7d693fa06b2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:55.007539 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-670a7c6a-1125-49ca-8059-b7d693fa06b2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:55.016304 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-670a7c6a-1125-49ca-8059-b7d693fa06b2 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 200 len: 1503 microversion: 2.1 time: 0.239582 May 16 19:09:55.025728 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 144/270] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:54 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 1503 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:09:55.704582 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e610f9ac-19a1-45dd-8d27-fff9bddc41ad tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:55.705199 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e610f9ac-19a1-45dd-8d27-fff9bddc41ad tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:55.712115 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e610f9ac-19a1-45dd-8d27-fff9bddc41ad tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:55.712550 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e610f9ac-19a1-45dd-8d27-fff9bddc41ad tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:55.713576 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e610f9ac-19a1-45dd-8d27-fff9bddc41ad tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:55.714152 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e610f9ac-19a1-45dd-8d27-fff9bddc41ad tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:56.035531 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-04ad4155-f858-4f34-b1d3-9d8a7ab4d5ef tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:56.035531 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-04ad4155-f858-4f34-b1d3-9d8a7ab4d5ef tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:56.042806 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-04ad4155-f858-4f34-b1d3-9d8a7ab4d5ef tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:56.043248 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-04ad4155-f858-4f34-b1d3-9d8a7ab4d5ef tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:56.044036 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-04ad4155-f858-4f34-b1d3-9d8a7ab4d5ef tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:56.044461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-04ad4155-f858-4f34-b1d3-9d8a7ab4d5ef tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:56.263756 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-04ad4155-f858-4f34-b1d3-9d8a7ab4d5ef tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:56.274738 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-04ad4155-f858-4f34-b1d3-9d8a7ab4d5ef tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 200 len: 1503 microversion: 2.1 time: 0.244906 May 16 19:09:56.275563 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 145/271] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:56 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 1503 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:56.328724 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e610f9ac-19a1-45dd-8d27-fff9bddc41ad tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:56.336686 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e610f9ac-19a1-45dd-8d27-fff9bddc41ad tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.636177 May 16 19:09:56.338378 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 127/272] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:55 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:57.194803 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-eadecf10-c7da-4daa-ba38-8dbd89b0b1c0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:57.195972 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-eadecf10-c7da-4daa-ba38-8dbd89b0b1c0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:57.210793 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eadecf10-c7da-4daa-ba38-8dbd89b0b1c0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:57.211352 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eadecf10-c7da-4daa-ba38-8dbd89b0b1c0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:57.212229 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eadecf10-c7da-4daa-ba38-8dbd89b0b1c0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:57.212683 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eadecf10-c7da-4daa-ba38-8dbd89b0b1c0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:57.255341 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-eadecf10-c7da-4daa-ba38-8dbd89b0b1c0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/ips" status: 200 len: 145 microversion: 2.1 time: 0.064203 May 16 19:09:57.256046 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 146/273] 10.222.0.24 () {58 vars in 1247 bytes} [Mon May 16 19:09:57 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/ips => generated 145 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:09:57.292904 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ff9a04d2-58ed-4032-bfc9-0075904049e5 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:57.293468 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ff9a04d2-58ed-4032-bfc9-0075904049e5 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:57.300777 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ff9a04d2-58ed-4032-bfc9-0075904049e5 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:57.301274 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ff9a04d2-58ed-4032-bfc9-0075904049e5 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:57.302097 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ff9a04d2-58ed-4032-bfc9-0075904049e5 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:57.302526 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ff9a04d2-58ed-4032-bfc9-0075904049e5 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:57.354177 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9fd8dc94-5dca-4ceb-937c-9147b1623902 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:57.355799 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9fd8dc94-5dca-4ceb-937c-9147b1623902 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:57.363736 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9fd8dc94-5dca-4ceb-937c-9147b1623902 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:57.364540 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9fd8dc94-5dca-4ceb-937c-9147b1623902 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:57.365793 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9fd8dc94-5dca-4ceb-937c-9147b1623902 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:57.366434 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9fd8dc94-5dca-4ceb-937c-9147b1623902 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:57.562216 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-9fd8dc94-5dca-4ceb-937c-9147b1623902 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:57.570830 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9fd8dc94-5dca-4ceb-937c-9147b1623902 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.220936 May 16 19:09:57.572983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 147/274] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:57 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:09:57.586806 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ff9a04d2-58ed-4032-bfc9-0075904049e5 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:57.599569 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ff9a04d2-58ed-4032-bfc9-0075904049e5 tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 200 len: 1503 microversion: 2.1 time: 0.311051 May 16 19:09:57.600160 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 128/275] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:57 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 1503 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:58.590773 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-253af770-e2f5-4638-810d-18498908d881 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:58.592234 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-253af770-e2f5-4638-810d-18498908d881 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:58.598592 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-adc19b06-44ab-4083-86c6-718fffb059d6 req-cef033ef-2421-493a-9c09-bbe558a070cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c97056-d30a-48e1-b7de-6d4189928110", "name": "network-vif-deleted", "tag": "82b86d38-e8bf-48de-b2c3-0b8bd5ac4c75"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:09:58.608771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-adc19b06-44ab-4083-86c6-718fffb059d6 req-cef033ef-2421-493a-9c09-bbe558a070cd service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:58.609451 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-adc19b06-44ab-4083-86c6-718fffb059d6 req-cef033ef-2421-493a-9c09-bbe558a070cd service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:58.613999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-253af770-e2f5-4638-810d-18498908d881 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:58.614824 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-253af770-e2f5-4638-810d-18498908d881 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:58.615813 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-253af770-e2f5-4638-810d-18498908d881 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:58.616475 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-253af770-e2f5-4638-810d-18498908d881 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:58.622543 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-adc19b06-44ab-4083-86c6-718fffb059d6 req-cef033ef-2421-493a-9c09-bbe558a070cd service nova] Creating event network-vif-deleted:82b86d38-e8bf-48de-b2c3-0b8bd5ac4c75 for instance 25c97056-d30a-48e1-b7de-6d4189928110 on hv-cinder-76606 May 16 19:09:58.628136 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-adc19b06-44ab-4083-86c6-718fffb059d6 req-cef033ef-2421-493a-9c09-bbe558a070cd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033183 May 16 19:09:58.628784 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 129/276] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:09:58.637163 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9b5c3e57-26fa-4dae-b34f-7b3c56a7cdea tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:58.637874 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9b5c3e57-26fa-4dae-b34f-7b3c56a7cdea tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:58.644531 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9b5c3e57-26fa-4dae-b34f-7b3c56a7cdea tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:58.645203 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9b5c3e57-26fa-4dae-b34f-7b3c56a7cdea tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:58.646209 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9b5c3e57-26fa-4dae-b34f-7b3c56a7cdea tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:58.646864 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9b5c3e57-26fa-4dae-b34f-7b3c56a7cdea tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:58.766807 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9b5c3e57-26fa-4dae-b34f-7b3c56a7cdea tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ac79259d304d589aa1e529849bfcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:58.775791 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9b5c3e57-26fa-4dae-b34f-7b3c56a7cdea tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 200 len: 1461 microversion: 2.1 time: 0.142638 May 16 19:09:58.776390 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 130/277] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:58 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 1461 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:58.803558 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-253af770-e2f5-4638-810d-18498908d881 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:09:58.813291 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-253af770-e2f5-4638-810d-18498908d881 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.227198 May 16 19:09:58.814920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 148/278] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:58 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:09:59.796510 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-473bc948-ee20-4fd9-afca-43a11ca335fb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:59.798004 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-473bc948-ee20-4fd9-afca-43a11ca335fb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] [instance: 25c97056-d30a-48e1-b7de-6d4189928110] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:59.804953 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-473bc948-ee20-4fd9-afca-43a11ca335fb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:59.805729 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-473bc948-ee20-4fd9-afca-43a11ca335fb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:59.806847 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-473bc948-ee20-4fd9-afca-43a11ca335fb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:59.807630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-473bc948-ee20-4fd9-afca-43a11ca335fb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:59.824302 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-473bc948-ee20-4fd9-afca-43a11ca335fb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] HTTP exception thrown: Instance 25c97056-d30a-48e1-b7de-6d4189928110 could not be found. May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-473bc948-ee20-4fd9-afca-43a11ca335fb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Request method failure captured: May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 HTTP/1.1 May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqFRD7RxLbU80EIWA37-0DpxPH1L753HJkhHuIHAupXJ2c564ByRkWg1tG1RN31IqzlK65Vms2n4dOA19Q-UNv1VTfDBDWbdZnHmW7-ac2ldlhWIh4_d6uyHlw1vMSD8VgPYAA9Tpltv4UV6SGAe1_OGfUVucKC-H4m41NK4LzZsRUs May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: f7b9188e991a4a7bb57c8a5beb3fb278 May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-VolumesActionsTest-1837558772 May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:09:59.826288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:09:59.827505 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f7b9188e991a4a7bb57c8a5beb3fb278"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f7b9188e991a4a7bb57c8a5beb3fb278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/f7b9188e991a4a7bb57c8a5beb3fb278"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_f7b9188e991a4a7bb57c8a5beb3fb278"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:09:59.827505 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-VolumesActionsTest-1837558772 May 16 19:09:59.827505 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: f7b9188e991a4a7bb57c8a5beb3fb278 May 16 19:09:59.827505 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-VolumesActionsTest-1837558772 May 16 19:09:59.827505 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-VolumesActionsTest-1837558772-project May 16 19:09:59.827505 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:09:59.827505 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:09:59.827505 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: c8ac79259d304d589aa1e529849bfcbe May 16 19:09:59.827505 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-VolumesActionsTest-1837558772-project May 16 19:09:59.827505 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:09:59.827505 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance 25c97056-d30a-48e1-b7de-6d4189928110 could not be found. May 16 19:09:59.827505 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': '25c97056-d30a-48e1-b7de-6d4189928110'} May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c97056-d30a-48e1-b7de-6d4189928110 could not be found. May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:09:59.828196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c97056-d30a-48e1-b7de-6d4189928110 could not be found. May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c97056-d30a-48e1-b7de-6d4189928110 could not be found. May 16 19:09:59.829315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:09:59.837472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-6fab346e-adf3-4d40-97d0-83b2754ae50c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:09:59.839138 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-6fab346e-adf3-4d40-97d0-83b2754ae50c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:09:59.844065 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-473bc948-ee20-4fd9-afca-43a11ca335fb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] Returning 404 to user: Instance 25c97056-d30a-48e1-b7de-6d4189928110 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:09:59.847134 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-473bc948-ee20-4fd9-afca-43a11ca335fb tempest-VolumesActionsTest-1837558772 tempest-VolumesActionsTest-1837558772-project] 10.222.0.24 "GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110" status: 404 len: 111 microversion: 2.1 time: 0.053194 May 16 19:09:59.853687 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6fab346e-adf3-4d40-97d0-83b2754ae50c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:59.854343 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 131/279] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:59 2022] GET /compute/v2.1/servers/25c97056-d30a-48e1-b7de-6d4189928110 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:09:59.855089 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6fab346e-adf3-4d40-97d0-83b2754ae50c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:09:59.856134 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6fab346e-adf3-4d40-97d0-83b2754ae50c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:09:59.857059 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6fab346e-adf3-4d40-97d0-83b2754ae50c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:00.136693 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6fab346e-adf3-4d40-97d0-83b2754ae50c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:00.151382 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-6fab346e-adf3-4d40-97d0-83b2754ae50c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.318856 May 16 19:10:00.152330 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 149/280] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:09:59 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:00.379641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e5eb3635-bfa5-4719-8214-bd95ac34195d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9421465-95c1-4125-a75a-c8ab114db038"}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:00.380726 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e5eb3635-bfa5-4719-8214-bd95ac34195d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:00.395675 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5eb3635-bfa5-4719-8214-bd95ac34195d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:00.398481 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5eb3635-bfa5-4719-8214-bd95ac34195d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:00.399724 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5eb3635-bfa5-4719-8214-bd95ac34195d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:00.403060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5eb3635-bfa5-4719-8214-bd95ac34195d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:01.182155 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b641181c-b19a-4122-b781-f8dcad69e349 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:01.182794 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b641181c-b19a-4122-b781-f8dcad69e349 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:01.198315 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b641181c-b19a-4122-b781-f8dcad69e349 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:01.200782 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b641181c-b19a-4122-b781-f8dcad69e349 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:01.201789 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b641181c-b19a-4122-b781-f8dcad69e349 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:01.202231 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b641181c-b19a-4122-b781-f8dcad69e349 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:01.445053 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b641181c-b19a-4122-b781-f8dcad69e349 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:01.453994 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b641181c-b19a-4122-b781-f8dcad69e349 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.289492 May 16 19:10:01.457289 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 150/281] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:01 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:02.173460 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1a792bb1-6a4c-4421-a617-6275c3d4f175 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:02.174175 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1a792bb1-6a4c-4421-a617-6275c3d4f175 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:02.186920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1a792bb1-6a4c-4421-a617-6275c3d4f175 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:02.188110 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1a792bb1-6a4c-4421-a617-6275c3d4f175 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:02.189933 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1a792bb1-6a4c-4421-a617-6275c3d4f175 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:02.190530 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1a792bb1-6a4c-4421-a617-6275c3d4f175 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:02.249768 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1a792bb1-6a4c-4421-a617-6275c3d4f175 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7/ips" status: 200 len: 148 microversion: 2.1 time: 0.082672 May 16 19:10:02.250977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 151/282] 10.222.0.24 () {58 vars in 1247 bytes} [Mon May 16 19:10:02 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7/ips => generated 148 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:10:02.475988 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-68848a2b-69f9-4df1-8a8c-859f97b785d9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:02.478168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-68848a2b-69f9-4df1-8a8c-859f97b785d9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:02.496383 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-68848a2b-69f9-4df1-8a8c-859f97b785d9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:02.498226 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-68848a2b-69f9-4df1-8a8c-859f97b785d9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:02.500090 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-68848a2b-69f9-4df1-8a8c-859f97b785d9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:02.500561 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-68848a2b-69f9-4df1-8a8c-859f97b785d9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:02.830582 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-68848a2b-69f9-4df1-8a8c-859f97b785d9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:02.841718 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-68848a2b-69f9-4df1-8a8c-859f97b785d9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.372749 May 16 19:10:02.845097 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 152/283] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:02 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:03.860352 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-abfb13e6-fc75-4982-b840-134159053b56 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:03.862194 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-abfb13e6-fc75-4982-b840-134159053b56 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:03.869167 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-abfb13e6-fc75-4982-b840-134159053b56 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:03.870117 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-abfb13e6-fc75-4982-b840-134159053b56 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:03.871612 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-abfb13e6-fc75-4982-b840-134159053b56 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:03.872755 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-abfb13e6-fc75-4982-b840-134159053b56 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:04.102812 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-abfb13e6-fc75-4982-b840-134159053b56 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:04.121684 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-abfb13e6-fc75-4982-b840-134159053b56 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.265091 May 16 19:10:04.122540 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 153/284] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:03 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:04.266794 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e5eb3635-bfa5-4719-8214-bd95ac34195d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "POST /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.892014 May 16 19:10:04.268582 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 132/285] 10.222.0.24 () {60 vars in 1322 bytes} [Mon May 16 19:10:00 2022] POST /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/os-volume_attachments => generated 194 bytes in 3895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:10:05.139580 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-499f4548-faee-4d12-b86c-4cbbe9acc4a0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:05.143247 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-499f4548-faee-4d12-b86c-4cbbe9acc4a0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:05.159726 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-499f4548-faee-4d12-b86c-4cbbe9acc4a0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:05.160372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-499f4548-faee-4d12-b86c-4cbbe9acc4a0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:05.161505 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-499f4548-faee-4d12-b86c-4cbbe9acc4a0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:05.162142 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-499f4548-faee-4d12-b86c-4cbbe9acc4a0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:05.234263 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e12e36d5-e0b4-449e-aa35-106fc50c8f02 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17a42e5e-9a96-4798-81cf-c57aa1c25f0c"}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:05.235693 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e12e36d5-e0b4-449e-aa35-106fc50c8f02 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:05.257382 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e12e36d5-e0b4-449e-aa35-106fc50c8f02 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:05.258051 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e12e36d5-e0b4-449e-aa35-106fc50c8f02 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:05.258998 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e12e36d5-e0b4-449e-aa35-106fc50c8f02 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:05.259425 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e12e36d5-e0b4-449e-aa35-106fc50c8f02 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:05.444886 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-499f4548-faee-4d12-b86c-4cbbe9acc4a0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:05.469405 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-499f4548-faee-4d12-b86c-4cbbe9acc4a0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1521 microversion: 2.1 time: 0.333344 May 16 19:10:05.480884 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 154/286] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:05 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:06.442198 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e12e36d5-e0b4-449e-aa35-106fc50c8f02 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "POST /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.209617 May 16 19:10:06.451555 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 133/287] 10.222.0.24 () {60 vars in 1322 bytes} [Mon May 16 19:10:05 2022] POST /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7/os-volume_attachments => generated 194 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:10:06.489105 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-baca6df1-2c0a-4ef8-a31c-3e19b35ceffa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:06.489959 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-baca6df1-2c0a-4ef8-a31c-3e19b35ceffa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:06.503691 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-baca6df1-2c0a-4ef8-a31c-3e19b35ceffa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:06.505905 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-baca6df1-2c0a-4ef8-a31c-3e19b35ceffa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:06.506989 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-baca6df1-2c0a-4ef8-a31c-3e19b35ceffa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:06.507454 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-baca6df1-2c0a-4ef8-a31c-3e19b35ceffa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:06.824608 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-baca6df1-2c0a-4ef8-a31c-3e19b35ceffa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:06.833041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-baca6df1-2c0a-4ef8-a31c-3e19b35ceffa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1501 microversion: 2.1 time: 0.348614 May 16 19:10:06.848033 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 155/288] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:06 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1501 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:06.854453 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f4bafda5-f937-4ef7-8cb2-9603119fbcf4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:06.855300 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f4bafda5-f937-4ef7-8cb2-9603119fbcf4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:06.862770 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f4bafda5-f937-4ef7-8cb2-9603119fbcf4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:06.863590 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f4bafda5-f937-4ef7-8cb2-9603119fbcf4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:06.864585 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f4bafda5-f937-4ef7-8cb2-9603119fbcf4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:06.865222 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f4bafda5-f937-4ef7-8cb2-9603119fbcf4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:07.003422 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f4bafda5-f937-4ef7-8cb2-9603119fbcf4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:07.021306 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f4bafda5-f937-4ef7-8cb2-9603119fbcf4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1514 microversion: 2.1 time: 0.171428 May 16 19:10:07.022639 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 134/289] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:06 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:09.777883 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d98cd827-e707-4256-a5de-2c046f32c5ed tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:09.779115 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d98cd827-e707-4256-a5de-2c046f32c5ed tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:09.794574 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d98cd827-e707-4256-a5de-2c046f32c5ed tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:09.795022 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d98cd827-e707-4256-a5de-2c046f32c5ed tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:09.795848 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d98cd827-e707-4256-a5de-2c046f32c5ed tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:09.796314 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d98cd827-e707-4256-a5de-2c046f32c5ed tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:09.872584 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d98cd827-e707-4256-a5de-2c046f32c5ed tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/ips" status: 200 len: 151 microversion: 2.20 time: 0.100046 May 16 19:10:09.873180 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 156/290] 10.222.0.24 () {60 vars in 1288 bytes} [Mon May 16 19:10:09 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/ips => generated 151 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:10:10.336318 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-bd300ca5-bd97-41b4-b97e-197908952c05 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:10.338046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-bd300ca5-bd97-41b4-b97e-197908952c05 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:10.357349 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd300ca5-bd97-41b4-b97e-197908952c05 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:10.359808 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd300ca5-bd97-41b4-b97e-197908952c05 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:10.363485 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd300ca5-bd97-41b4-b97e-197908952c05 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:10.364999 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd300ca5-bd97-41b4-b97e-197908952c05 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:10.426662 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-bd300ca5-bd97-41b4-b97e-197908952c05 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lazy-loading 'flavor' on Instance uuid 9cc4667a-a2c3-459c-ac05-45720bc0f622 {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:10:10.638626 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-bd300ca5-bd97-41b4-b97e-197908952c05 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "POST /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622/action" status: 200 len: 32 microversion: 2.1 time: 0.307840 May 16 19:10:10.640224 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 135/291] 10.222.0.24 () {60 vars in 1277 bytes} [Mon May 16 19:10:10 2022] POST /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622/action => generated 32 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 19:10:10.657588 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d26fbf86-2634-44cb-acf2-405dfaed5599 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:10.658418 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d26fbf86-2634-44cb-acf2-405dfaed5599 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:10.667172 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d26fbf86-2634-44cb-acf2-405dfaed5599 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:10.669872 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d26fbf86-2634-44cb-acf2-405dfaed5599 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:10.670685 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d26fbf86-2634-44cb-acf2-405dfaed5599 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:10.671119 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d26fbf86-2634-44cb-acf2-405dfaed5599 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:11.271887 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d26fbf86-2634-44cb-acf2-405dfaed5599 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:11.325232 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d26fbf86-2634-44cb-acf2-405dfaed5599 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.678668 May 16 19:10:11.336597 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 157/292] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:10 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:12.348506 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4e7f6510-8d09-427f-a03b-e4d7de73e970 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:12.357561 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-4e7f6510-8d09-427f-a03b-e4d7de73e970 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:12.371585 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4e7f6510-8d09-427f-a03b-e4d7de73e970 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:12.373100 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4e7f6510-8d09-427f-a03b-e4d7de73e970 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:12.379403 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4e7f6510-8d09-427f-a03b-e4d7de73e970 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:12.380246 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4e7f6510-8d09-427f-a03b-e4d7de73e970 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:12.402180 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8f2876dc-77cd-4df2-bfd0-2ec2c1899619 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:12.402837 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8f2876dc-77cd-4df2-bfd0-2ec2c1899619 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:12.412104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8f2876dc-77cd-4df2-bfd0-2ec2c1899619 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:12.412555 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8f2876dc-77cd-4df2-bfd0-2ec2c1899619 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:12.413348 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8f2876dc-77cd-4df2-bfd0-2ec2c1899619 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:12.413808 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8f2876dc-77cd-4df2-bfd0-2ec2c1899619 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:12.474784 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.objects.instance [None req-8f2876dc-77cd-4df2-bfd0-2ec2c1899619 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lazy-loading 'flavor' on Instance uuid d5b53695-b6e7-4e7b-b6d5-539770d20f41 {{(pid=117275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:10:12.760345 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4e7f6510-8d09-427f-a03b-e4d7de73e970 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:12.770403 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4e7f6510-8d09-427f-a03b-e4d7de73e970 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.426382 May 16 19:10:12.771604 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 136/293] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:12 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:12.798858 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-91fedc00-6b4c-457d-8174-e59d936a3b4b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:12.808887 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-91fedc00-6b4c-457d-8174-e59d936a3b4b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:12.809789 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-91fedc00-6b4c-457d-8174-e59d936a3b4b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:12.894538 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-91fedc00-6b4c-457d-8174-e59d936a3b4b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Going to try to stop instance {{(pid=117274) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 19:10:12.985407 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-91fedc00-6b4c-457d-8174-e59d936a3b4b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "POST /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/action" status: 202 len: 0 microversion: 2.1 time: 0.191595 May 16 19:10:12.987672 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 137/294] 10.222.0.24 () {60 vars in 1277 bytes} [Mon May 16 19:10:12 2022] POST /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:10:12.997843 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7ec39cb4-4c23-4d32-a101-358b07d07251 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:12.999473 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7ec39cb4-4c23-4d32-a101-358b07d07251 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:13.010160 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7ec39cb4-4c23-4d32-a101-358b07d07251 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:13.012301 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7ec39cb4-4c23-4d32-a101-358b07d07251 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:13.013369 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7ec39cb4-4c23-4d32-a101-358b07d07251 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:13.014238 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7ec39cb4-4c23-4d32-a101-358b07d07251 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:13.266802 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7ec39cb4-4c23-4d32-a101-358b07d07251 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:13.276991 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7ec39cb4-4c23-4d32-a101-358b07d07251 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1722 microversion: 2.1 time: 0.283266 May 16 19:10:13.276991 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 138/295] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:12 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:13.790349 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-491b1ab5-d1ad-45c8-9860-9b682ca1dfb4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:13.791063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-491b1ab5-d1ad-45c8-9860-9b682ca1dfb4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:13.800791 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-491b1ab5-d1ad-45c8-9860-9b682ca1dfb4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:13.801237 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-491b1ab5-d1ad-45c8-9860-9b682ca1dfb4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:13.802076 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-491b1ab5-d1ad-45c8-9860-9b682ca1dfb4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:13.802498 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-491b1ab5-d1ad-45c8-9860-9b682ca1dfb4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:14.006515 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-491b1ab5-d1ad-45c8-9860-9b682ca1dfb4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:14.014973 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-491b1ab5-d1ad-45c8-9860-9b682ca1dfb4 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.228913 May 16 19:10:14.015625 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 139/296] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:13 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:14.298860 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9068bb5a-8a1a-4826-be46-13d36d177582 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:14.299918 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9068bb5a-8a1a-4826-be46-13d36d177582 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:14.315443 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9068bb5a-8a1a-4826-be46-13d36d177582 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:14.317786 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9068bb5a-8a1a-4826-be46-13d36d177582 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:14.320300 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9068bb5a-8a1a-4826-be46-13d36d177582 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:14.320904 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9068bb5a-8a1a-4826-be46-13d36d177582 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:14.614472 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9068bb5a-8a1a-4826-be46-13d36d177582 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:14.634091 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9068bb5a-8a1a-4826-be46-13d36d177582 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1722 microversion: 2.1 time: 0.340213 May 16 19:10:14.635141 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 140/297] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:14 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1722 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:15.031882 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5779577c-355c-4d8c-88ed-0256c0c18f79 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:15.033210 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5779577c-355c-4d8c-88ed-0256c0c18f79 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:15.047236 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5779577c-355c-4d8c-88ed-0256c0c18f79 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:15.047698 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5779577c-355c-4d8c-88ed-0256c0c18f79 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:15.048496 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5779577c-355c-4d8c-88ed-0256c0c18f79 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:15.048951 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5779577c-355c-4d8c-88ed-0256c0c18f79 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:15.344985 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-5779577c-355c-4d8c-88ed-0256c0c18f79 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:15.360034 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-5779577c-355c-4d8c-88ed-0256c0c18f79 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.332239 May 16 19:10:15.369477 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 141/298] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:15 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:15.652565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0d122c34-5749-4730-ae18-382950403d5e tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:15.653207 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0d122c34-5749-4730-ae18-382950403d5e tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:15.661214 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0d122c34-5749-4730-ae18-382950403d5e tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:15.661729 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0d122c34-5749-4730-ae18-382950403d5e tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:15.666733 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0d122c34-5749-4730-ae18-382950403d5e tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:15.667244 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0d122c34-5749-4730-ae18-382950403d5e tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:15.948975 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0d122c34-5749-4730-ae18-382950403d5e tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:15.967350 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0d122c34-5749-4730-ae18-382950403d5e tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1722 microversion: 2.1 time: 0.319157 May 16 19:10:15.968137 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 142/299] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:15 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:16.376352 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-cb9603b6-56b9-41c3-8a93-32439784e2fb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:16.376968 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-cb9603b6-56b9-41c3-8a93-32439784e2fb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:16.386247 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cb9603b6-56b9-41c3-8a93-32439784e2fb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:16.386703 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cb9603b6-56b9-41c3-8a93-32439784e2fb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:16.387494 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cb9603b6-56b9-41c3-8a93-32439784e2fb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:16.387926 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cb9603b6-56b9-41c3-8a93-32439784e2fb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:16.555729 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-cb9603b6-56b9-41c3-8a93-32439784e2fb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:16.566466 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-cb9603b6-56b9-41c3-8a93-32439784e2fb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.193968 May 16 19:10:16.568285 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 143/300] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:16 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:16.990548 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-cfdff0a0-82c0-4ae0-9a6b-00a0af4fc733 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:16.991404 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-cfdff0a0-82c0-4ae0-9a6b-00a0af4fc733 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:17.000706 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cfdff0a0-82c0-4ae0-9a6b-00a0af4fc733 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:17.005095 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cfdff0a0-82c0-4ae0-9a6b-00a0af4fc733 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:17.006169 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cfdff0a0-82c0-4ae0-9a6b-00a0af4fc733 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:17.006762 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cfdff0a0-82c0-4ae0-9a6b-00a0af4fc733 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:17.529424 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-cfdff0a0-82c0-4ae0-9a6b-00a0af4fc733 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:17.539395 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-cfdff0a0-82c0-4ae0-9a6b-00a0af4fc733 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1722 microversion: 2.1 time: 0.552687 May 16 19:10:17.543995 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 144/301] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:16 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1722 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:17.584699 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4f8f4a6c-e37e-4681-b3ac-d0c82c3d2e6f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:17.585699 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-4f8f4a6c-e37e-4681-b3ac-d0c82c3d2e6f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:17.593100 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4f8f4a6c-e37e-4681-b3ac-d0c82c3d2e6f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:17.599513 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4f8f4a6c-e37e-4681-b3ac-d0c82c3d2e6f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:17.600815 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4f8f4a6c-e37e-4681-b3ac-d0c82c3d2e6f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:17.603554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4f8f4a6c-e37e-4681-b3ac-d0c82c3d2e6f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:17.851411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4f8f4a6c-e37e-4681-b3ac-d0c82c3d2e6f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:17.860943 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4f8f4a6c-e37e-4681-b3ac-d0c82c3d2e6f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.280158 May 16 19:10:17.871602 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 145/302] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:17 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:17.913319 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f35eaa01-f07e-4d97-909a-419bf5078ed4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Action: 'create', calling method: .version_select at 0x7f1e19014dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-199862353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk+Zqs2B2KNyVS7BzZjY2ilrtixNgFSDDB4khQ/4gGuqU7fZhrRlIndrUzJjhamvm/jmcNJRzuNyxvxMUImtd4d9XcEJCcUIgLqUA2IYyvTUi80sbdQWWqtfynOv6R7pw=="}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:17.939364 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-f35eaa01-f07e-4d97-909a-419bf5078ed4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Getting quotas for project 84949fef3a77459fbf02d0804bafdc4a. Resources: {'key_pairs'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:10:17.944129 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-f35eaa01-f07e-4d97-909a-419bf5078ed4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Getting quotas for user 2aba8a58b6c24e548a8ab08cfa5bb857 and project 84949fef3a77459fbf02d0804bafdc4a. Resources: {'key_pairs'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:10:18.024096 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f35eaa01-f07e-4d97-909a-419bf5078ed4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.116034 May 16 19:10:18.038490 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 146/303] 10.222.0.24 () {60 vars in 1158 bytes} [Mon May 16 19:10:17 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:10:18.211927 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-dfe8c54e-4d95-45b8-a295-5b2cde54b4cf tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1475437188", "imageRef": "b9b1ba12-5ddc-4d48-97c3-edd3a5953e4f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-199862353", "networks": [{"uuid": "a0f4becd-a191-415b-ad1c-fb9e538ef619"}]}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:18.340130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8f2876dc-77cd-4df2-bfd0-2ec2c1899619 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "POST /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/action" status: 202 len: 0 microversion: 2.20 time: 5.942324 May 16 19:10:18.341756 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 158/304] 10.222.0.24 () {62 vars in 1318 bytes} [Mon May 16 19:10:12 2022] POST /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/action => generated 0 bytes in 5945 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 19:10:18.362229 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c8894709-94b6-4263-9058-a2072081e884 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:18.363118 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c8894709-94b6-4263-9058-a2072081e884 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:18.369873 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.network.neutron [None req-dfe8c54e-4d95-45b8-a295-5b2cde54b4cf tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] validate_networks() for [('a0f4becd-a191-415b-ad1c-fb9e538ef619', None, None, None, None, None)] {{(pid=117274) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:10:18.385557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c8894709-94b6-4263-9058-a2072081e884 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:18.386369 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c8894709-94b6-4263-9058-a2072081e884 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:18.387335 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c8894709-94b6-4263-9058-a2072081e884 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:18.387960 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c8894709-94b6-4263-9058-a2072081e884 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:18.662445 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c8894709-94b6-4263-9058-a2072081e884 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:18.687355 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c8894709-94b6-4263-9058-a2072081e884 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:18.698081 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c8894709-94b6-4263-9058-a2072081e884 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:18.699931 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c8894709-94b6-4263-9058-a2072081e884 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1724 microversion: 2.20 time: 0.345332 May 16 19:10:18.705362 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 159/305] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:18 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1724 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:18.716541 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-79e2f557-d135-4dda-a43d-13ac9e9b48ed tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:18.717152 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-79e2f557-d135-4dda-a43d-13ac9e9b48ed tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:18.733589 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-79e2f557-d135-4dda-a43d-13ac9e9b48ed tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:18.738101 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-79e2f557-d135-4dda-a43d-13ac9e9b48ed tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:18.739032 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-79e2f557-d135-4dda-a43d-13ac9e9b48ed tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:18.739612 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-79e2f557-d135-4dda-a43d-13ac9e9b48ed tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:18.954176 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-dfe8c54e-4d95-45b8-a295-5b2cde54b4cf tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Flavor limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:10:18.955673 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-dfe8c54e-4d95-45b8-a295-5b2cde54b4cf tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Image limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:10:18.956308 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-dfe8c54e-4d95-45b8-a295-5b2cde54b4cf tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Flavor pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:10:18.957047 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-dfe8c54e-4d95-45b8-a295-5b2cde54b4cf tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Image pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:10:18.958114 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-dfe8c54e-4d95-45b8-a295-5b2cde54b4cf tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:10:18.971847 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dfe8c54e-4d95-45b8-a295-5b2cde54b4cf tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:18.972751 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dfe8c54e-4d95-45b8-a295-5b2cde54b4cf tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:18.973758 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dfe8c54e-4d95-45b8-a295-5b2cde54b4cf tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:18.974363 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dfe8c54e-4d95-45b8-a295-5b2cde54b4cf tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:18.979465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-79e2f557-d135-4dda-a43d-13ac9e9b48ed tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:18.991727 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-79e2f557-d135-4dda-a43d-13ac9e9b48ed tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1722 microversion: 2.1 time: 0.280791 May 16 19:10:18.994789 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 160/306] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:18 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:19.001498 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8fa9c9ad-492a-4d9d-87e0-63d0f866fc01 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:19.002636 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8fa9c9ad-492a-4d9d-87e0-63d0f866fc01 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:19.006525 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-dfe8c54e-4d95-45b8-a295-5b2cde54b4cf tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Getting quotas for project 84949fef3a77459fbf02d0804bafdc4a. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:10:19.016257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-dfe8c54e-4d95-45b8-a295-5b2cde54b4cf tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Getting quotas for user 2aba8a58b6c24e548a8ab08cfa5bb857 and project 84949fef3a77459fbf02d0804bafdc4a. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:10:19.019974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8fa9c9ad-492a-4d9d-87e0-63d0f866fc01 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:19.020480 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8fa9c9ad-492a-4d9d-87e0-63d0f866fc01 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:19.023118 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8fa9c9ad-492a-4d9d-87e0-63d0f866fc01 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:19.025098 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8fa9c9ad-492a-4d9d-87e0-63d0f866fc01 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:19.031303 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-dfe8c54e-4d95-45b8-a295-5b2cde54b4cf tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Going to run 1 instances... {{(pid=117274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:10:19.034485 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-dfe8c54e-4d95-45b8-a295-5b2cde54b4cf tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9b1ba12-5ddc-4d48-97c3-edd3a5953e4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:10:19.121661 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-dfe8c54e-4d95-45b8-a295-5b2cde54b4cf tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912257 May 16 19:10:19.124971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 147/307] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:10:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:10:19.138645 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c2a00b37-71a1-463a-ad7c-696a69705f0f tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:19.139722 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c2a00b37-71a1-463a-ad7c-696a69705f0f tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:19.270204 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c2a00b37-71a1-463a-ad7c-696a69705f0f tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:19.278935 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c2a00b37-71a1-463a-ad7c-696a69705f0f tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1258 microversion: 2.1 time: 0.147668 May 16 19:10:19.283390 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 148/308] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:19 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:19.303554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d18918cd-0e5d-4ab3-b97f-9213a05bec8c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Action: 'create', calling method: .version_select at 0x7f1e18f43550>, body: {"keypair": {"name": "tempest-keypair-1015605764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq+PsxJTCWoEimNrLhk5nz3BhiyGr5N/C1EL2PNxqB0pHrjuZFkI9J12we2gSOVMVY1anxXoKFU2z1M3F88PxoMZ4MHJoIVs5cUhoP1D2Ud6LJP8e6nQxXuQ+jxJ1xAwg=="}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:19.322000 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-d18918cd-0e5d-4ab3-b97f-9213a05bec8c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Getting quotas for project dd195af6f92c42a18ed7051eae26dbaa. Resources: {'key_pairs'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:10:19.328614 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-d18918cd-0e5d-4ab3-b97f-9213a05bec8c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Getting quotas for user 7d3af11e1ffc4ab1a37669f893d2f3be and project dd195af6f92c42a18ed7051eae26dbaa. Resources: {'key_pairs'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:10:19.360585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8fa9c9ad-492a-4d9d-87e0-63d0f866fc01 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:19.361112 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d18918cd-0e5d-4ab3-b97f-9213a05bec8c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062691 May 16 19:10:19.361840 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 149/309] 10.222.0.24 () {60 vars in 1158 bytes} [Mon May 16 19:10:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:10:19.374277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8fa9c9ad-492a-4d9d-87e0-63d0f866fc01 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.377837 May 16 19:10:19.383400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 161/310] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:18 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:19.723999 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-86bbe35a-9687-43d4-be48-a36757f9ff6a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:19.724612 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-86bbe35a-9687-43d4-be48-a36757f9ff6a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:19.747950 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-86bbe35a-9687-43d4-be48-a36757f9ff6a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:19.749837 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-86bbe35a-9687-43d4-be48-a36757f9ff6a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:19.754375 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-86bbe35a-9687-43d4-be48-a36757f9ff6a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:19.759595 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-86bbe35a-9687-43d4-be48-a36757f9ff6a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:20.011647 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-de5a0b8a-0b8c-4d84-82ad-b9792640fe88 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:20.012441 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-de5a0b8a-0b8c-4d84-82ad-b9792640fe88 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:20.033498 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-de5a0b8a-0b8c-4d84-82ad-b9792640fe88 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:20.035388 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-de5a0b8a-0b8c-4d84-82ad-b9792640fe88 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:20.037906 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-de5a0b8a-0b8c-4d84-82ad-b9792640fe88 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:20.040379 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-de5a0b8a-0b8c-4d84-82ad-b9792640fe88 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:20.103430 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-86bbe35a-9687-43d4-be48-a36757f9ff6a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:20.111643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-86bbe35a-9687-43d4-be48-a36757f9ff6a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:20.118863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-86bbe35a-9687-43d4-be48-a36757f9ff6a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:20.134596 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-86bbe35a-9687-43d4-be48-a36757f9ff6a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1724 microversion: 2.20 time: 0.413027 May 16 19:10:20.135202 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 150/311] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:19 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1724 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:20.298192 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-230cd50f-51d6-4209-aefe-97350c0fa2ac tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:20.299133 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-230cd50f-51d6-4209-aefe-97350c0fa2ac tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:20.312217 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-230cd50f-51d6-4209-aefe-97350c0fa2ac tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:20.315063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-230cd50f-51d6-4209-aefe-97350c0fa2ac tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:20.320741 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-230cd50f-51d6-4209-aefe-97350c0fa2ac tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:20.321249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-230cd50f-51d6-4209-aefe-97350c0fa2ac tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:20.340238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-de5a0b8a-0b8c-4d84-82ad-b9792640fe88 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:20.352380 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-de5a0b8a-0b8c-4d84-82ad-b9792640fe88 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1722 microversion: 2.1 time: 0.346149 May 16 19:10:20.353573 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 162/312] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:20 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:20.392440 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e045bd18-eb75-4fa8-b73c-dd954aa7517f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:20.393879 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e045bd18-eb75-4fa8-b73c-dd954aa7517f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:20.408162 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e045bd18-eb75-4fa8-b73c-dd954aa7517f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:20.408162 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e045bd18-eb75-4fa8-b73c-dd954aa7517f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:20.408162 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e045bd18-eb75-4fa8-b73c-dd954aa7517f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:20.408162 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e045bd18-eb75-4fa8-b73c-dd954aa7517f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:20.486473 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-230cd50f-51d6-4209-aefe-97350c0fa2ac tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:20.496225 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-230cd50f-51d6-4209-aefe-97350c0fa2ac tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1310 microversion: 2.1 time: 0.203624 May 16 19:10:20.497800 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 151/313] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:20 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1310 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:20.666843 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e045bd18-eb75-4fa8-b73c-dd954aa7517f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:20.677318 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e045bd18-eb75-4fa8-b73c-dd954aa7517f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.288637 May 16 19:10:20.678544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 163/314] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:20 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:21.156523 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-3d2334da-ddb7-4021-b8b2-95e8113ff3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:21.157143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-3d2334da-ddb7-4021-b8b2-95e8113ff3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:21.164352 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3d2334da-ddb7-4021-b8b2-95e8113ff3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:21.164806 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3d2334da-ddb7-4021-b8b2-95e8113ff3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:21.165617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3d2334da-ddb7-4021-b8b2-95e8113ff3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:21.166053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3d2334da-ddb7-4021-b8b2-95e8113ff3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:21.371973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ac0786f3-9e20-4991-b865-093febc65417 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:21.372589 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ac0786f3-9e20-4991-b865-093febc65417 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:21.384997 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ac0786f3-9e20-4991-b865-093febc65417 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:21.390427 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ac0786f3-9e20-4991-b865-093febc65417 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:21.391517 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ac0786f3-9e20-4991-b865-093febc65417 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:21.398294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ac0786f3-9e20-4991-b865-093febc65417 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:21.670653 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-3d2334da-ddb7-4021-b8b2-95e8113ff3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:21.749379 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-3d2334da-ddb7-4021-b8b2-95e8113ff3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:21.761613 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-3d2334da-ddb7-4021-b8b2-95e8113ff3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:21.770096 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-3d2334da-ddb7-4021-b8b2-95e8113ff3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1724 microversion: 2.20 time: 0.614474 May 16 19:10:21.770991 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 152/315] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:21 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1724 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:21.805782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-aeda299f-1e39-46d8-a539-5b3d14d0cfc1 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:21.806774 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-aeda299f-1e39-46d8-a539-5b3d14d0cfc1 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:21.838028 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-aeda299f-1e39-46d8-a539-5b3d14d0cfc1 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:21.838691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-aeda299f-1e39-46d8-a539-5b3d14d0cfc1 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:21.841115 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-aeda299f-1e39-46d8-a539-5b3d14d0cfc1 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:21.841879 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-aeda299f-1e39-46d8-a539-5b3d14d0cfc1 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:22.040023 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-aeda299f-1e39-46d8-a539-5b3d14d0cfc1 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:22.057490 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-aeda299f-1e39-46d8-a539-5b3d14d0cfc1 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1316 microversion: 2.1 time: 0.281783 May 16 19:10:22.060840 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 153/316] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:21 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:22.074404 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2c4489f2-dfac-48bc-8700-bcce3875b830 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:22.079080 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2c4489f2-dfac-48bc-8700-bcce3875b830 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:22.100682 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c4489f2-dfac-48bc-8700-bcce3875b830 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:22.104386 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c4489f2-dfac-48bc-8700-bcce3875b830 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:22.106281 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c4489f2-dfac-48bc-8700-bcce3875b830 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:22.108405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c4489f2-dfac-48bc-8700-bcce3875b830 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:22.230755 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ac0786f3-9e20-4991-b865-093febc65417 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:22.248759 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ac0786f3-9e20-4991-b865-093febc65417 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1722 microversion: 2.1 time: 0.876545 May 16 19:10:22.283045 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 164/317] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:21 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1722 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:22.537001 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2c4489f2-dfac-48bc-8700-bcce3875b830 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:22.548981 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2c4489f2-dfac-48bc-8700-bcce3875b830 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.486806 May 16 19:10:22.553352 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 154/318] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:22 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:22.793230 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5382dc1c-b0fa-4102-b03d-de84c9f0ca6e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:22.794644 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5382dc1c-b0fa-4102-b03d-de84c9f0ca6e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:22.802121 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5382dc1c-b0fa-4102-b03d-de84c9f0ca6e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:22.802907 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5382dc1c-b0fa-4102-b03d-de84c9f0ca6e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:22.803915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5382dc1c-b0fa-4102-b03d-de84c9f0ca6e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:22.804627 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5382dc1c-b0fa-4102-b03d-de84c9f0ca6e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:23.064798 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5382dc1c-b0fa-4102-b03d-de84c9f0ca6e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:23.078892 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f6f04d9b-023b-4684-bbac-368fb8367531 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:23.079685 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f6f04d9b-023b-4684-bbac-368fb8367531 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:23.102403 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f6f04d9b-023b-4684-bbac-368fb8367531 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:23.102851 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f6f04d9b-023b-4684-bbac-368fb8367531 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:23.112222 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5382dc1c-b0fa-4102-b03d-de84c9f0ca6e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:23.124285 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5382dc1c-b0fa-4102-b03d-de84c9f0ca6e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:23.126277 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f6f04d9b-023b-4684-bbac-368fb8367531 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:23.126751 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f6f04d9b-023b-4684-bbac-368fb8367531 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:23.127903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5382dc1c-b0fa-4102-b03d-de84c9f0ca6e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1724 microversion: 2.20 time: 0.342154 May 16 19:10:23.134207 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 165/319] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:22 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:23.291532 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5bdf941a-be32-46b1-8ce7-fdbf31f40a6b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:23.292418 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5bdf941a-be32-46b1-8ce7-fdbf31f40a6b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:23.303392 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5bdf941a-be32-46b1-8ce7-fdbf31f40a6b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:23.307194 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5bdf941a-be32-46b1-8ce7-fdbf31f40a6b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:23.308278 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5bdf941a-be32-46b1-8ce7-fdbf31f40a6b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:23.313763 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5bdf941a-be32-46b1-8ce7-fdbf31f40a6b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:23.597580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f6f04d9b-023b-4684-bbac-368fb8367531 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:23.605397 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f6f04d9b-023b-4684-bbac-368fb8367531 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1358 microversion: 2.1 time: 0.530373 May 16 19:10:23.618301 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 155/320] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:23 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1358 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:23.623873 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7fea94c5-5226-4766-82e9-a254802093d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1816765966", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9cbd7ed-b011-47eb-8de6-48451d865294"}], "security_groups": [{"name": "tempest-securitygroup--2061456490"}], "key_name": "tempest-keypair-1015605764", "user_data": "}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:24.011143 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5bdf941a-be32-46b1-8ce7-fdbf31f40a6b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:24.019772 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5bdf941a-be32-46b1-8ce7-fdbf31f40a6b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1722 microversion: 2.1 time: 0.733167 May 16 19:10:24.040146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 166/321] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:23 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1722 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:24.053072 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4adbf578-a77a-4bce-b478-3d5372d332ea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:24.059454 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-4adbf578-a77a-4bce-b478-3d5372d332ea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:24.081705 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4adbf578-a77a-4bce-b478-3d5372d332ea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:24.082218 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4adbf578-a77a-4bce-b478-3d5372d332ea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:24.083017 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4adbf578-a77a-4bce-b478-3d5372d332ea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:24.083500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4adbf578-a77a-4bce-b478-3d5372d332ea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:24.697371 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4adbf578-a77a-4bce-b478-3d5372d332ea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:24.709902 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4adbf578-a77a-4bce-b478-3d5372d332ea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.666882 May 16 19:10:24.710704 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 167/322] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:24 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:24.728547 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b9a8fc87-dee8-4ffd-bffa-ca1f8b9e83d3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:24.729317 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b9a8fc87-dee8-4ffd-bffa-ca1f8b9e83d3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:24.747672 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b9a8fc87-dee8-4ffd-bffa-ca1f8b9e83d3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:24.749454 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b9a8fc87-dee8-4ffd-bffa-ca1f8b9e83d3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:24.752643 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b9a8fc87-dee8-4ffd-bffa-ca1f8b9e83d3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:24.753435 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b9a8fc87-dee8-4ffd-bffa-ca1f8b9e83d3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:25.248912 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b9a8fc87-dee8-4ffd-bffa-ca1f8b9e83d3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:25.267916 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b9a8fc87-dee8-4ffd-bffa-ca1f8b9e83d3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:25.271903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b9a8fc87-dee8-4ffd-bffa-ca1f8b9e83d3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:25.273616 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b9a8fc87-dee8-4ffd-bffa-ca1f8b9e83d3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1724 microversion: 2.20 time: 0.559201 May 16 19:10:25.274535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 168/323] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:24 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1724 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:25.280647 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-4ecb3654-8e42-4d7a-b3c4-af06ceb0f207 req-9b6efd94-0282-41d0-a883-25ab1637e404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e0298bd-7166-4b67-acf1-794621e95cdf", "tag": "12358361-c4bc-4509-98f8-117b7fd4543e"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:25.291854 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-4ecb3654-8e42-4d7a-b3c4-af06ceb0f207 req-9b6efd94-0282-41d0-a883-25ab1637e404 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:25.294199 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-4ecb3654-8e42-4d7a-b3c4-af06ceb0f207 req-9b6efd94-0282-41d0-a883-25ab1637e404 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:25.311350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-4ecb3654-8e42-4d7a-b3c4-af06ceb0f207 req-9b6efd94-0282-41d0-a883-25ab1637e404 service nova] Creating event network-changed:12358361-c4bc-4509-98f8-117b7fd4543e for instance 1e0298bd-7166-4b67-acf1-794621e95cdf on hv-cinder-76606 May 16 19:10:25.321568 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-4ecb3654-8e42-4d7a-b3c4-af06ceb0f207 req-9b6efd94-0282-41d0-a883-25ab1637e404 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044913 May 16 19:10:25.322494 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 169/324] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:10:25.343468 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b993bf59-cda7-43ec-9897-57c1b35c2a53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:25.344183 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b993bf59-cda7-43ec-9897-57c1b35c2a53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:25.356852 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b993bf59-cda7-43ec-9897-57c1b35c2a53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:25.358141 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b993bf59-cda7-43ec-9897-57c1b35c2a53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:25.360411 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b993bf59-cda7-43ec-9897-57c1b35c2a53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:25.361609 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b993bf59-cda7-43ec-9897-57c1b35c2a53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:25.667241 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b993bf59-cda7-43ec-9897-57c1b35c2a53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:25.676550 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b993bf59-cda7-43ec-9897-57c1b35c2a53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1358 microversion: 2.1 time: 0.348647 May 16 19:10:25.682162 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 170/325] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:25 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1358 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:25.696469 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-6573ddb3-1987-47c4-a917-d76b07ef8b28 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:25.697335 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-6573ddb3-1987-47c4-a917-d76b07ef8b28 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:25.715015 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6573ddb3-1987-47c4-a917-d76b07ef8b28 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:25.716020 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6573ddb3-1987-47c4-a917-d76b07ef8b28 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:25.717017 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6573ddb3-1987-47c4-a917-d76b07ef8b28 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:25.719987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6573ddb3-1987-47c4-a917-d76b07ef8b28 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:26.118052 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6573ddb3-1987-47c4-a917-d76b07ef8b28 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:26.132760 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-6573ddb3-1987-47c4-a917-d76b07ef8b28 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1722 microversion: 2.1 time: 0.449226 May 16 19:10:26.137830 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 171/326] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:25 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1722 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:26.142847 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-525f6149-04b7-4afa-9337-037015cb9c5f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:26.149392 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-525f6149-04b7-4afa-9337-037015cb9c5f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:26.162454 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-525f6149-04b7-4afa-9337-037015cb9c5f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:26.167403 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-525f6149-04b7-4afa-9337-037015cb9c5f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:26.170125 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-525f6149-04b7-4afa-9337-037015cb9c5f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:26.172777 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-525f6149-04b7-4afa-9337-037015cb9c5f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:26.406219 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-525f6149-04b7-4afa-9337-037015cb9c5f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:26.418182 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-525f6149-04b7-4afa-9337-037015cb9c5f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.278992 May 16 19:10:26.439066 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 172/327] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:26 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:26.444825 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0d1ef88b-3487-49a9-b085-91f2c20c2dcc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-354429185", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452", "networks": [{"uuid": "65373252-c9ac-449c-8d31-248e5b6ba06c"}]}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:31.546061 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.network.neutron [None req-0d1ef88b-3487-49a9-b085-91f2c20c2dcc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] validate_networks() for [('65373252-c9ac-449c-8d31-248e5b6ba06c', None, None, None, None, None)] {{(pid=117275) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:10:31.640568 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.network.neutron [None req-7fea94c5-5226-4766-82e9-a254802093d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] validate_networks() for [('b9cbd7ed-b011-47eb-8de6-48451d865294', None, None, None, None, None)] {{(pid=117274) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:10:32.319928 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-7fea94c5-5226-4766-82e9-a254802093d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Flavor limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:10:32.324830 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-7fea94c5-5226-4766-82e9-a254802093d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Image limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:10:32.326069 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-7fea94c5-5226-4766-82e9-a254802093d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Flavor pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:10:32.326655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-7fea94c5-5226-4766-82e9-a254802093d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Image pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:10:32.327251 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-7fea94c5-5226-4766-82e9-a254802093d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:10:32.340408 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7fea94c5-5226-4766-82e9-a254802093d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:32.341327 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7fea94c5-5226-4766-82e9-a254802093d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:32.342309 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7fea94c5-5226-4766-82e9-a254802093d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:32.343015 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7fea94c5-5226-4766-82e9-a254802093d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:32.381653 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-7fea94c5-5226-4766-82e9-a254802093d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Getting quotas for project dd195af6f92c42a18ed7051eae26dbaa. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:10:32.387011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-7fea94c5-5226-4766-82e9-a254802093d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Getting quotas for user 7d3af11e1ffc4ab1a37669f893d2f3be and project dd195af6f92c42a18ed7051eae26dbaa. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:10:32.403328 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7fea94c5-5226-4766-82e9-a254802093d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Going to run 1 instances... {{(pid=117274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:10:32.406382 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7fea94c5-5226-4766-82e9-a254802093d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:10:32.588855 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7fea94c5-5226-4766-82e9-a254802093d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 8.968323 May 16 19:10:32.599100 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 156/328] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:10:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 8980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:10:32.621071 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-0d1ef88b-3487-49a9-b085-91f2c20c2dcc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Flavor limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:10:32.621611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-0d1ef88b-3487-49a9-b085-91f2c20c2dcc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Image limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:10:32.622578 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-0d1ef88b-3487-49a9-b085-91f2c20c2dcc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Flavor pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:10:32.622980 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-0d1ef88b-3487-49a9-b085-91f2c20c2dcc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Image pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:10:32.623383 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-0d1ef88b-3487-49a9-b085-91f2c20c2dcc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:10:32.640463 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0d1ef88b-3487-49a9-b085-91f2c20c2dcc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:32.640910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0d1ef88b-3487-49a9-b085-91f2c20c2dcc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:32.650555 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0d1ef88b-3487-49a9-b085-91f2c20c2dcc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:32.651372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0d1ef88b-3487-49a9-b085-91f2c20c2dcc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:32.659397 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-59d7c73d-6508-4407-ba03-903c0fb93f10 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:32.663258 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-59d7c73d-6508-4407-ba03-903c0fb93f10 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:32.681759 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-59d7c73d-6508-4407-ba03-903c0fb93f10 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:32.685607 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-59d7c73d-6508-4407-ba03-903c0fb93f10 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:32.687026 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-59d7c73d-6508-4407-ba03-903c0fb93f10 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:32.687682 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-59d7c73d-6508-4407-ba03-903c0fb93f10 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:32.783896 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-0d1ef88b-3487-49a9-b085-91f2c20c2dcc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Getting quotas for project 3f47a5832eba495e9a74266e13420ebb. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:10:32.794509 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-0d1ef88b-3487-49a9-b085-91f2c20c2dcc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Getting quotas for user 94079d9bd7b843f09e1345a79b51e447 and project 3f47a5832eba495e9a74266e13420ebb. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:10:32.851971 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0d1ef88b-3487-49a9-b085-91f2c20c2dcc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Going to run 1 instances... {{(pid=117275) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:10:32.854425 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0d1ef88b-3487-49a9-b085-91f2c20c2dcc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:10:33.010661 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-59d7c73d-6508-4407-ba03-903c0fb93f10 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:33.015756 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0d1ef88b-3487-49a9-b085-91f2c20c2dcc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.574755 May 16 19:10:33.016423 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 173/329] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:10:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 6576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:10:33.041037 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-6d3f9831-b6f5-451c-a89f-940961e23d67 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:33.043181 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-6d3f9831-b6f5-451c-a89f-940961e23d67 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:33.063413 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6d3f9831-b6f5-451c-a89f-940961e23d67 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:33.069083 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6d3f9831-b6f5-451c-a89f-940961e23d67 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:33.072431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6d3f9831-b6f5-451c-a89f-940961e23d67 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:33.072714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-59d7c73d-6508-4407-ba03-903c0fb93f10 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:33.074410 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-59d7c73d-6508-4407-ba03-903c0fb93f10 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:33.075111 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6d3f9831-b6f5-451c-a89f-940961e23d67 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:33.075656 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-59d7c73d-6508-4407-ba03-903c0fb93f10 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1724 microversion: 2.20 time: 0.473758 May 16 19:10:33.076247 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 157/330] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:32 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1724 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:33.099658 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-029c51eb-51e6-42b0-90e2-a30222771c5d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:33.100397 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-029c51eb-51e6-42b0-90e2-a30222771c5d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:33.142000 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-029c51eb-51e6-42b0-90e2-a30222771c5d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:33.144386 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-029c51eb-51e6-42b0-90e2-a30222771c5d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:33.145190 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-029c51eb-51e6-42b0-90e2-a30222771c5d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:33.145694 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-029c51eb-51e6-42b0-90e2-a30222771c5d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:33.592529 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-029c51eb-51e6-42b0-90e2-a30222771c5d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:33.617728 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-029c51eb-51e6-42b0-90e2-a30222771c5d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1699 microversion: 2.1 time: 0.537836 May 16 19:10:33.618523 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 158/331] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:33 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1699 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:33.631877 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2857a9e5-772b-4109-b94c-609ebddaed9b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:33.632711 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2857a9e5-772b-4109-b94c-609ebddaed9b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:33.660858 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2857a9e5-772b-4109-b94c-609ebddaed9b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:33.661429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2857a9e5-772b-4109-b94c-609ebddaed9b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:33.662915 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2857a9e5-772b-4109-b94c-609ebddaed9b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:33.663353 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2857a9e5-772b-4109-b94c-609ebddaed9b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:33.921247 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6d3f9831-b6f5-451c-a89f-940961e23d67 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:33.938448 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-6d3f9831-b6f5-451c-a89f-940961e23d67 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1358 microversion: 2.1 time: 0.909796 May 16 19:10:33.942093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 174/332] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:33 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1358 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:33.962382 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-832ddb8b-b7e7-4d1f-b9f7-b9c40c0c55ea tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:33.968375 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-832ddb8b-b7e7-4d1f-b9f7-b9c40c0c55ea tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:33.993858 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-832ddb8b-b7e7-4d1f-b9f7-b9c40c0c55ea tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:34.008447 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-832ddb8b-b7e7-4d1f-b9f7-b9c40c0c55ea tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:34.015735 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-832ddb8b-b7e7-4d1f-b9f7-b9c40c0c55ea tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:34.016217 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-832ddb8b-b7e7-4d1f-b9f7-b9c40c0c55ea tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:34.027496 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2857a9e5-772b-4109-b94c-609ebddaed9b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:34.035719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2857a9e5-772b-4109-b94c-609ebddaed9b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.415485 May 16 19:10:34.038833 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 159/333] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:33 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:34.052221 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0832d107-4844-4561-a9ef-d17f21e19eb3 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:34.053229 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0832d107-4844-4561-a9ef-d17f21e19eb3 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:34.216229 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0832d107-4844-4561-a9ef-d17f21e19eb3 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:34.227029 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0832d107-4844-4561-a9ef-d17f21e19eb3 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1218 microversion: 2.1 time: 0.184891 May 16 19:10:34.227986 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 160/334] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:34 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1218 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:34.233974 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-37273058-32e2-4e8c-b11c-deea337050a0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:34.242566 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-832ddb8b-b7e7-4d1f-b9f7-b9c40c0c55ea tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:34.250867 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-832ddb8b-b7e7-4d1f-b9f7-b9c40c0c55ea tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1246 microversion: 2.1 time: 0.306939 May 16 19:10:34.259046 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 175/335] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:33 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1246 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:34.263365 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-37273058-32e2-4e8c-b11c-deea337050a0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:34.265354 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-37273058-32e2-4e8c-b11c-deea337050a0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:34.273966 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0bedbd91-0d1a-4903-8694-859b833ea7d7 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:34.274919 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0bedbd91-0d1a-4903-8694-859b833ea7d7 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:34.293130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0bedbd91-0d1a-4903-8694-859b833ea7d7 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:34.293746 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0bedbd91-0d1a-4903-8694-859b833ea7d7 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:34.296015 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0bedbd91-0d1a-4903-8694-859b833ea7d7 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:34.296642 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0bedbd91-0d1a-4903-8694-859b833ea7d7 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:34.321016 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-37273058-32e2-4e8c-b11c-deea337050a0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Going to try to start instance {{(pid=117274) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 19:10:34.426778 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-37273058-32e2-4e8c-b11c-deea337050a0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "POST /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/action" status: 202 len: 0 microversion: 2.1 time: 0.194023 May 16 19:10:34.435144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 161/336] 10.222.0.24 () {60 vars in 1277 bytes} [Mon May 16 19:10:34 2022] POST /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:10:34.449803 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-59a372d6-d653-4803-b274-b113dce63488 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:34.450969 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-59a372d6-d653-4803-b274-b113dce63488 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:34.459786 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-59a372d6-d653-4803-b274-b113dce63488 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:34.460623 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-59a372d6-d653-4803-b274-b113dce63488 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:34.463058 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-59a372d6-d653-4803-b274-b113dce63488 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:34.464184 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-59a372d6-d653-4803-b274-b113dce63488 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:34.604872 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0bedbd91-0d1a-4903-8694-859b833ea7d7 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:34.621371 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0bedbd91-0d1a-4903-8694-859b833ea7d7 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:34.627743 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0bedbd91-0d1a-4903-8694-859b833ea7d7 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:34.644158 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0bedbd91-0d1a-4903-8694-859b833ea7d7 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1745 microversion: 2.20 time: 0.379787 May 16 19:10:34.660082 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 176/337] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:34 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1745 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:34.779824 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-59a372d6-d653-4803-b274-b113dce63488 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:34.812909 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-59a372d6-d653-4803-b274-b113dce63488 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1708 microversion: 2.1 time: 0.374261 May 16 19:10:34.814333 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 162/338] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:34 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1708 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:34.960945 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d192d90c-99fc-4d7a-b052-6e811670ca7e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:34.961735 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d192d90c-99fc-4d7a-b052-6e811670ca7e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:34.969120 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d192d90c-99fc-4d7a-b052-6e811670ca7e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:34.974536 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d192d90c-99fc-4d7a-b052-6e811670ca7e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:34.976045 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d192d90c-99fc-4d7a-b052-6e811670ca7e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:34.976828 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d192d90c-99fc-4d7a-b052-6e811670ca7e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:35.054874 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-18449d6c-2201-4ea7-a6ea-993e944dac39 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:35.057081 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-18449d6c-2201-4ea7-a6ea-993e944dac39 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:35.065506 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-18449d6c-2201-4ea7-a6ea-993e944dac39 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:35.068607 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-18449d6c-2201-4ea7-a6ea-993e944dac39 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:35.069659 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-18449d6c-2201-4ea7-a6ea-993e944dac39 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:35.072380 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-18449d6c-2201-4ea7-a6ea-993e944dac39 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:35.209682 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d192d90c-99fc-4d7a-b052-6e811670ca7e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:35.222173 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d192d90c-99fc-4d7a-b052-6e811670ca7e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1358 microversion: 2.1 time: 0.266149 May 16 19:10:35.223938 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 177/339] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:34 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:35.244544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d1ea01d4-6c59-4427-a5c1-0937a4e6f986 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:35.245161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d1ea01d4-6c59-4427-a5c1-0937a4e6f986 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:35.257407 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1ea01d4-6c59-4427-a5c1-0937a4e6f986 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:35.258011 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1ea01d4-6c59-4427-a5c1-0937a4e6f986 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:35.259088 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1ea01d4-6c59-4427-a5c1-0937a4e6f986 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:35.259488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1ea01d4-6c59-4427-a5c1-0937a4e6f986 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:35.342797 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-18449d6c-2201-4ea7-a6ea-993e944dac39 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:35.353096 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-18449d6c-2201-4ea7-a6ea-993e944dac39 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.301911 May 16 19:10:35.360233 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 163/340] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:35 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:35.372893 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d1ea01d4-6c59-4427-a5c1-0937a4e6f986 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:35.376250 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5dc2be10-7a69-4b70-a610-baef11ce7f57 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:35.377025 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5dc2be10-7a69-4b70-a610-baef11ce7f57 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:35.381766 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d1ea01d4-6c59-4427-a5c1-0937a4e6f986 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1270 microversion: 2.1 time: 0.141147 May 16 19:10:35.384925 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 178/341] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:35 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1270 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:35.388846 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5dc2be10-7a69-4b70-a610-baef11ce7f57 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:35.389599 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5dc2be10-7a69-4b70-a610-baef11ce7f57 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:35.390574 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5dc2be10-7a69-4b70-a610-baef11ce7f57 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:35.394370 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5dc2be10-7a69-4b70-a610-baef11ce7f57 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:35.496349 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-5dc2be10-7a69-4b70-a610-baef11ce7f57 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:35.504526 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-5dc2be10-7a69-4b70-a610-baef11ce7f57 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1294 microversion: 2.1 time: 0.142735 May 16 19:10:35.505098 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 164/342] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:35 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1294 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:35.668047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c69868cf-3b55-4aad-b608-23b4301cae8d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:35.668745 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c69868cf-3b55-4aad-b608-23b4301cae8d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:35.679561 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c69868cf-3b55-4aad-b608-23b4301cae8d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:35.680302 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c69868cf-3b55-4aad-b608-23b4301cae8d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:35.681241 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c69868cf-3b55-4aad-b608-23b4301cae8d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:35.681846 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c69868cf-3b55-4aad-b608-23b4301cae8d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:35.832667 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-653f819c-4dd0-4c83-b1e0-2b72b676480a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:35.833282 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-653f819c-4dd0-4c83-b1e0-2b72b676480a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:35.846435 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-653f819c-4dd0-4c83-b1e0-2b72b676480a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:35.849953 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-653f819c-4dd0-4c83-b1e0-2b72b676480a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:35.855118 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-653f819c-4dd0-4c83-b1e0-2b72b676480a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:35.855733 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-653f819c-4dd0-4c83-b1e0-2b72b676480a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:36.044522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c69868cf-3b55-4aad-b608-23b4301cae8d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:36.056345 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c69868cf-3b55-4aad-b608-23b4301cae8d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:36.058148 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c69868cf-3b55-4aad-b608-23b4301cae8d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:36.062865 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c69868cf-3b55-4aad-b608-23b4301cae8d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1745 microversion: 2.20 time: 0.399173 May 16 19:10:36.063681 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 179/343] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:35 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1745 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:36.241051 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-bb2880b0-765c-48e6-9351-8244296198a0 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:36.242291 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-bb2880b0-765c-48e6-9351-8244296198a0 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:36.251146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bb2880b0-765c-48e6-9351-8244296198a0 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:36.253469 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bb2880b0-765c-48e6-9351-8244296198a0 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:36.256410 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bb2880b0-765c-48e6-9351-8244296198a0 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:36.257041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bb2880b0-765c-48e6-9351-8244296198a0 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:36.263801 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-653f819c-4dd0-4c83-b1e0-2b72b676480a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:36.275738 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-653f819c-4dd0-4c83-b1e0-2b72b676480a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1708 microversion: 2.1 time: 0.447206 May 16 19:10:36.277685 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 165/344] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:35 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1708 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:36.371437 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-6b9a9745-7b4c-47a7-93a2-1c67411355b6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:36.372052 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-6b9a9745-7b4c-47a7-93a2-1c67411355b6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:36.387729 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6b9a9745-7b4c-47a7-93a2-1c67411355b6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:36.388188 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6b9a9745-7b4c-47a7-93a2-1c67411355b6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:36.389256 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6b9a9745-7b4c-47a7-93a2-1c67411355b6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:36.389726 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6b9a9745-7b4c-47a7-93a2-1c67411355b6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:36.652836 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-bb2880b0-765c-48e6-9351-8244296198a0 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:36.665396 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-6b9a9745-7b4c-47a7-93a2-1c67411355b6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:36.670608 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-bb2880b0-765c-48e6-9351-8244296198a0 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1358 microversion: 2.1 time: 0.433934 May 16 19:10:36.676767 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-6b9a9745-7b4c-47a7-93a2-1c67411355b6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.310556 May 16 19:10:36.677474 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 166/345] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:36 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:36.682408 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 180/346] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:36 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1358 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:36.682787 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c5521812-3ed9-45aa-bb36-fb06723e6543 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:36.683502 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c5521812-3ed9-45aa-bb36-fb06723e6543 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:36.692239 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5bc91afd-8aba-49e7-bfdc-0a8e2931a3f3 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:36.692571 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c5521812-3ed9-45aa-bb36-fb06723e6543 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:36.693162 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5bc91afd-8aba-49e7-bfdc-0a8e2931a3f3 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:36.694410 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c5521812-3ed9-45aa-bb36-fb06723e6543 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:36.695515 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c5521812-3ed9-45aa-bb36-fb06723e6543 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:36.696410 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c5521812-3ed9-45aa-bb36-fb06723e6543 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:36.705182 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5bc91afd-8aba-49e7-bfdc-0a8e2931a3f3 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:36.706615 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5bc91afd-8aba-49e7-bfdc-0a8e2931a3f3 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:36.708238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5bc91afd-8aba-49e7-bfdc-0a8e2931a3f3 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:36.708843 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5bc91afd-8aba-49e7-bfdc-0a8e2931a3f3 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:36.816823 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c5521812-3ed9-45aa-bb36-fb06723e6543 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:36.833462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5bc91afd-8aba-49e7-bfdc-0a8e2931a3f3 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:36.836566 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c5521812-3ed9-45aa-bb36-fb06723e6543 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1270 microversion: 2.1 time: 0.157773 May 16 19:10:36.837169 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 167/347] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:36 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:36.878643 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5bc91afd-8aba-49e7-bfdc-0a8e2931a3f3 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1294 microversion: 2.1 time: 0.178507 May 16 19:10:36.881665 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 181/348] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:36 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1294 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:37.081919 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-3a8772cc-47d7-48b9-85b6-cd0e72ee50b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:37.083148 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-3a8772cc-47d7-48b9-85b6-cd0e72ee50b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:37.094859 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3a8772cc-47d7-48b9-85b6-cd0e72ee50b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:37.097485 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3a8772cc-47d7-48b9-85b6-cd0e72ee50b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:37.103211 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3a8772cc-47d7-48b9-85b6-cd0e72ee50b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:37.107107 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3a8772cc-47d7-48b9-85b6-cd0e72ee50b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:37.296560 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-eeddf5ce-362d-4f70-9fbd-4bdc8a8617f5 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:37.297177 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-eeddf5ce-362d-4f70-9fbd-4bdc8a8617f5 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:37.304624 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eeddf5ce-362d-4f70-9fbd-4bdc8a8617f5 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:37.305273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eeddf5ce-362d-4f70-9fbd-4bdc8a8617f5 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:37.306696 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eeddf5ce-362d-4f70-9fbd-4bdc8a8617f5 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:37.307276 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eeddf5ce-362d-4f70-9fbd-4bdc8a8617f5 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:37.468575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-eeddf5ce-362d-4f70-9fbd-4bdc8a8617f5 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:37.477555 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-eeddf5ce-362d-4f70-9fbd-4bdc8a8617f5 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1708 microversion: 2.1 time: 0.186319 May 16 19:10:37.478495 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 182/349] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:37 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1708 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:37.688594 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0d66f0a8-14cd-4f83-8b66-a98987fc37a7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:37.689790 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0d66f0a8-14cd-4f83-8b66-a98987fc37a7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:37.697006 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0d66f0a8-14cd-4f83-8b66-a98987fc37a7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:37.697702 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0d66f0a8-14cd-4f83-8b66-a98987fc37a7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:37.698679 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0d66f0a8-14cd-4f83-8b66-a98987fc37a7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:37.699449 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0d66f0a8-14cd-4f83-8b66-a98987fc37a7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:37.700288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-3a8772cc-47d7-48b9-85b6-cd0e72ee50b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:37.712682 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-3a8772cc-47d7-48b9-85b6-cd0e72ee50b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:37.715406 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-3a8772cc-47d7-48b9-85b6-cd0e72ee50b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:37.717549 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-3a8772cc-47d7-48b9-85b6-cd0e72ee50b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1745 microversion: 2.20 time: 0.639739 May 16 19:10:37.729899 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 168/350] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:37 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1745 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:37.735765 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-47ae8d7e-2e77-4092-af0b-0d731939ec25 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:37.736493 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-47ae8d7e-2e77-4092-af0b-0d731939ec25 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:37.744375 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-47ae8d7e-2e77-4092-af0b-0d731939ec25 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:37.744928 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-47ae8d7e-2e77-4092-af0b-0d731939ec25 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:37.745816 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-47ae8d7e-2e77-4092-af0b-0d731939ec25 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:37.746252 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-47ae8d7e-2e77-4092-af0b-0d731939ec25 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:37.862227 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0d66f0a8-14cd-4f83-8b66-a98987fc37a7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:37.874431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0d66f0a8-14cd-4f83-8b66-a98987fc37a7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1358 microversion: 2.1 time: 0.189830 May 16 19:10:37.875263 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 183/351] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:37 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:37.882264 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-61457ca1-74bd-43bf-a048-599b38271dcf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:37.883254 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-61457ca1-74bd-43bf-a048-599b38271dcf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:37.891956 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-61457ca1-74bd-43bf-a048-599b38271dcf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:37.892403 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-61457ca1-74bd-43bf-a048-599b38271dcf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:37.893223 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-61457ca1-74bd-43bf-a048-599b38271dcf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:37.893683 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-61457ca1-74bd-43bf-a048-599b38271dcf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:37.962227 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-61457ca1-74bd-43bf-a048-599b38271dcf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:37.969963 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-61457ca1-74bd-43bf-a048-599b38271dcf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1270 microversion: 2.1 time: 0.092730 May 16 19:10:37.970587 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 184/352] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:37 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:37.975876 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-fccf4829-bbc1-40a4-aa25-26c1d99444a6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:37.976655 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-fccf4829-bbc1-40a4-aa25-26c1d99444a6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:37.983288 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fccf4829-bbc1-40a4-aa25-26c1d99444a6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:37.983982 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fccf4829-bbc1-40a4-aa25-26c1d99444a6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:37.984765 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fccf4829-bbc1-40a4-aa25-26c1d99444a6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:37.985387 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fccf4829-bbc1-40a4-aa25-26c1d99444a6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:38.049338 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-47ae8d7e-2e77-4092-af0b-0d731939ec25 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:38.066245 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-47ae8d7e-2e77-4092-af0b-0d731939ec25 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.334620 May 16 19:10:38.077571 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-fccf4829-bbc1-40a4-aa25-26c1d99444a6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:38.077571 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-fccf4829-bbc1-40a4-aa25-26c1d99444a6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1302 microversion: 2.1 time: 0.104005 May 16 19:10:38.077571 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 185/353] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:37 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1302 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:38.085758 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 169/354] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:37 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:38.496984 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-edb85c46-4b39-4b2c-a049-10e4118a8f0d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:38.499226 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-edb85c46-4b39-4b2c-a049-10e4118a8f0d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:38.510906 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-edb85c46-4b39-4b2c-a049-10e4118a8f0d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:38.511753 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-edb85c46-4b39-4b2c-a049-10e4118a8f0d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:38.513095 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-edb85c46-4b39-4b2c-a049-10e4118a8f0d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:38.513876 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-edb85c46-4b39-4b2c-a049-10e4118a8f0d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:38.739006 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7e6280e9-04a3-470d-b24b-03931f7d7a36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:38.739688 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7e6280e9-04a3-470d-b24b-03931f7d7a36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:38.813319 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7e6280e9-04a3-470d-b24b-03931f7d7a36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:38.816080 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7e6280e9-04a3-470d-b24b-03931f7d7a36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:38.817570 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7e6280e9-04a3-470d-b24b-03931f7d7a36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:38.823289 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7e6280e9-04a3-470d-b24b-03931f7d7a36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:39.143648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-edb85c46-4b39-4b2c-a049-10e4118a8f0d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:39.177275 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-edb85c46-4b39-4b2c-a049-10e4118a8f0d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1708 microversion: 2.1 time: 0.685374 May 16 19:10:39.182077 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 186/355] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:38 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1708 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:39.187753 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-38f2930c-7c11-436f-b5d5-b5a46872f475 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:39.188536 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-38f2930c-7c11-436f-b5d5-b5a46872f475 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:39.196706 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-38f2930c-7c11-436f-b5d5-b5a46872f475 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:39.197147 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-38f2930c-7c11-436f-b5d5-b5a46872f475 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:39.197965 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-38f2930c-7c11-436f-b5d5-b5a46872f475 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:39.198555 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-38f2930c-7c11-436f-b5d5-b5a46872f475 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:39.255852 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7e6280e9-04a3-470d-b24b-03931f7d7a36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:39.275188 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7e6280e9-04a3-470d-b24b-03931f7d7a36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:39.277687 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7e6280e9-04a3-470d-b24b-03931f7d7a36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:39.279007 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7e6280e9-04a3-470d-b24b-03931f7d7a36 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1745 microversion: 2.20 time: 0.546471 May 16 19:10:39.279762 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 170/356] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:38 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1745 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:10:39.293820 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0637b23a-b47a-412e-a350-94811c662db7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:39.294712 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0637b23a-b47a-412e-a350-94811c662db7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:39.304616 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0637b23a-b47a-412e-a350-94811c662db7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:39.306421 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0637b23a-b47a-412e-a350-94811c662db7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:39.307387 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0637b23a-b47a-412e-a350-94811c662db7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:39.308077 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0637b23a-b47a-412e-a350-94811c662db7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:39.422760 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-38f2930c-7c11-436f-b5d5-b5a46872f475 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:39.434214 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-38f2930c-7c11-436f-b5d5-b5a46872f475 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1358 microversion: 2.1 time: 0.250839 May 16 19:10:39.436343 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 187/357] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:39 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:39.447753 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9f3eadf2-20e8-43e7-a542-e7815d0a9fa1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:39.448293 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9f3eadf2-20e8-43e7-a542-e7815d0a9fa1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:39.454813 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9f3eadf2-20e8-43e7-a542-e7815d0a9fa1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:39.455658 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9f3eadf2-20e8-43e7-a542-e7815d0a9fa1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:39.456797 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9f3eadf2-20e8-43e7-a542-e7815d0a9fa1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:39.457391 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9f3eadf2-20e8-43e7-a542-e7815d0a9fa1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:39.544111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0637b23a-b47a-412e-a350-94811c662db7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:39.556101 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0637b23a-b47a-412e-a350-94811c662db7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1288 microversion: 2.1 time: 0.271895 May 16 19:10:39.557760 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 171/358] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:39 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1288 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:39.566552 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0adf3eaa-5a07-4ca7-9bb9-63b7cb5caf2a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:39.568944 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0adf3eaa-5a07-4ca7-9bb9-63b7cb5caf2a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:39.586343 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0adf3eaa-5a07-4ca7-9bb9-63b7cb5caf2a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:39.588622 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0adf3eaa-5a07-4ca7-9bb9-63b7cb5caf2a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:39.590613 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0adf3eaa-5a07-4ca7-9bb9-63b7cb5caf2a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:39.592632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0adf3eaa-5a07-4ca7-9bb9-63b7cb5caf2a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:39.736828 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-9f3eadf2-20e8-43e7-a542-e7815d0a9fa1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:39.750080 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9f3eadf2-20e8-43e7-a542-e7815d0a9fa1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.312368 May 16 19:10:39.751131 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 188/359] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:39 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:39.760361 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0adf3eaa-5a07-4ca7-9bb9-63b7cb5caf2a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:39.772478 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0adf3eaa-5a07-4ca7-9bb9-63b7cb5caf2a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1300 microversion: 2.1 time: 0.213310 May 16 19:10:39.779543 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 172/360] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:39 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1300 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:39.916717 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-293dcada-6035-43cb-a18f-26ed664b1dcc req-314ad850-67a9-41e3-b6c6-9312250391f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b53695-b6e7-4e7b-b6d5-539770d20f41", "name": "network-vif-plugged", "status": "completed", "tag": "5ed69d31-3be1-4fa7-a495-fce15a7677cb"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:39.942022 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-293dcada-6035-43cb-a18f-26ed664b1dcc req-314ad850-67a9-41e3-b6c6-9312250391f1 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:39.942675 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-293dcada-6035-43cb-a18f-26ed664b1dcc req-314ad850-67a9-41e3-b6c6-9312250391f1 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:39.972069 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-293dcada-6035-43cb-a18f-26ed664b1dcc req-314ad850-67a9-41e3-b6c6-9312250391f1 service nova] Creating event network-vif-plugged:5ed69d31-3be1-4fa7-a495-fce15a7677cb for instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 on hv-cinder-76606 May 16 19:10:39.978670 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-293dcada-6035-43cb-a18f-26ed664b1dcc req-314ad850-67a9-41e3-b6c6-9312250391f1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069146 May 16 19:10:39.979891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 189/361] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:10:40.197770 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-74846c18-e4c2-4efc-be14-edf653515346 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:40.198477 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-74846c18-e4c2-4efc-be14-edf653515346 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:40.222929 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-74846c18-e4c2-4efc-be14-edf653515346 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:40.226158 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-74846c18-e4c2-4efc-be14-edf653515346 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:40.228195 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-74846c18-e4c2-4efc-be14-edf653515346 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:40.228683 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-74846c18-e4c2-4efc-be14-edf653515346 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:40.298476 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5cbd0591-03e5-4517-872d-0834c38cc0e5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:40.299464 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5cbd0591-03e5-4517-872d-0834c38cc0e5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:40.317817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5cbd0591-03e5-4517-872d-0834c38cc0e5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:40.319496 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5cbd0591-03e5-4517-872d-0834c38cc0e5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:40.323597 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5cbd0591-03e5-4517-872d-0834c38cc0e5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:40.327179 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5cbd0591-03e5-4517-872d-0834c38cc0e5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:40.710006 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-74846c18-e4c2-4efc-be14-edf653515346 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:40.722163 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-74846c18-e4c2-4efc-be14-edf653515346 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1708 microversion: 2.1 time: 0.529948 May 16 19:10:40.725283 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 173/362] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:40 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1708 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:40.737050 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-62af05d6-5ad9-4707-b616-a8cb23084b52 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:40.740409 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-62af05d6-5ad9-4707-b616-a8cb23084b52 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:40.766608 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-62af05d6-5ad9-4707-b616-a8cb23084b52 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:40.767171 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-62af05d6-5ad9-4707-b616-a8cb23084b52 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:40.767982 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-62af05d6-5ad9-4707-b616-a8cb23084b52 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:40.768413 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-62af05d6-5ad9-4707-b616-a8cb23084b52 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:41.078719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-62af05d6-5ad9-4707-b616-a8cb23084b52 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:41.097249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-62af05d6-5ad9-4707-b616-a8cb23084b52 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1358 microversion: 2.1 time: 0.369124 May 16 19:10:41.099855 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 174/363] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:40 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1358 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:41.114881 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-275d1199-920c-47c1-88e9-c935e360825f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:41.116098 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-275d1199-920c-47c1-88e9-c935e360825f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:41.132143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-275d1199-920c-47c1-88e9-c935e360825f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:41.134621 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-275d1199-920c-47c1-88e9-c935e360825f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:41.137219 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-275d1199-920c-47c1-88e9-c935e360825f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:41.138946 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-275d1199-920c-47c1-88e9-c935e360825f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:41.272838 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-275d1199-920c-47c1-88e9-c935e360825f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:41.284184 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-275d1199-920c-47c1-88e9-c935e360825f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1276 microversion: 2.1 time: 0.182122 May 16 19:10:41.287589 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 175/364] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:41 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1276 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:41.298197 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e6ab5c2f-3997-4904-baef-e8d5a95bbc7c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:41.301362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e6ab5c2f-3997-4904-baef-e8d5a95bbc7c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:41.320284 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e6ab5c2f-3997-4904-baef-e8d5a95bbc7c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:41.320935 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e6ab5c2f-3997-4904-baef-e8d5a95bbc7c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:41.321817 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e6ab5c2f-3997-4904-baef-e8d5a95bbc7c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:41.324938 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e6ab5c2f-3997-4904-baef-e8d5a95bbc7c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:41.593285 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e6ab5c2f-3997-4904-baef-e8d5a95bbc7c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:41.628533 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e6ab5c2f-3997-4904-baef-e8d5a95bbc7c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.339199 May 16 19:10:41.637479 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 176/365] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:41 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:41.652539 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-43dc74de-34d8-4055-9060-c9a768417d00 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:41.653274 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-43dc74de-34d8-4055-9060-c9a768417d00 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:41.684773 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-43dc74de-34d8-4055-9060-c9a768417d00 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:41.699871 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-43dc74de-34d8-4055-9060-c9a768417d00 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:41.700867 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-43dc74de-34d8-4055-9060-c9a768417d00 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:41.703555 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-43dc74de-34d8-4055-9060-c9a768417d00 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:41.794819 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5cbd0591-03e5-4517-872d-0834c38cc0e5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:41.812454 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5cbd0591-03e5-4517-872d-0834c38cc0e5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:41.820069 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5cbd0591-03e5-4517-872d-0834c38cc0e5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:41.823511 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5cbd0591-03e5-4517-872d-0834c38cc0e5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1740 microversion: 2.20 time: 1.529433 May 16 19:10:41.827001 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 190/366] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:40 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1740 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:10:41.849297 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c2a47de8-a362-4078-8235-f9901b699a40 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:41.857392 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c2a47de8-a362-4078-8235-f9901b699a40 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:41.862576 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-43dc74de-34d8-4055-9060-c9a768417d00 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:41.883994 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-43dc74de-34d8-4055-9060-c9a768417d00 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1300 microversion: 2.1 time: 0.243327 May 16 19:10:41.886671 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 177/367] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:41 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1300 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:41.896238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c2a47de8-a362-4078-8235-f9901b699a40 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:41.898468 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c2a47de8-a362-4078-8235-f9901b699a40 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:41.907485 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c2a47de8-a362-4078-8235-f9901b699a40 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:41.912987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c2a47de8-a362-4078-8235-f9901b699a40 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:42.116892 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-53a6f9b2-0ace-4c1d-afb4-25962ce77450 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:42.117787 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-53a6f9b2-0ace-4c1d-afb4-25962ce77450 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:42.130654 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-53a6f9b2-0ace-4c1d-afb4-25962ce77450 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:42.132474 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-53a6f9b2-0ace-4c1d-afb4-25962ce77450 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:42.136347 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-53a6f9b2-0ace-4c1d-afb4-25962ce77450 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:42.137641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-53a6f9b2-0ace-4c1d-afb4-25962ce77450 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:42.458767 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-53a6f9b2-0ace-4c1d-afb4-25962ce77450 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:42.466837 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-53a6f9b2-0ace-4c1d-afb4-25962ce77450 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1358 microversion: 2.1 time: 0.354599 May 16 19:10:42.468643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 178/368] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:42 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1358 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:42.473975 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-6125e57a-f4fc-4f3c-8ea8-03b4d822dc4f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:42.474768 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-6125e57a-f4fc-4f3c-8ea8-03b4d822dc4f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:42.486298 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6125e57a-f4fc-4f3c-8ea8-03b4d822dc4f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:42.486758 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6125e57a-f4fc-4f3c-8ea8-03b4d822dc4f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:42.499834 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6125e57a-f4fc-4f3c-8ea8-03b4d822dc4f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:42.500463 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6125e57a-f4fc-4f3c-8ea8-03b4d822dc4f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:42.669542 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-6125e57a-f4fc-4f3c-8ea8-03b4d822dc4f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:42.681765 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-6125e57a-f4fc-4f3c-8ea8-03b4d822dc4f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1276 microversion: 2.1 time: 0.211223 May 16 19:10:42.692323 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 179/369] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:42 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1276 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:42.697311 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5b47e92d-879f-4937-a43d-2578da20f579 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:42.700240 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5b47e92d-879f-4937-a43d-2578da20f579 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:42.720509 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5b47e92d-879f-4937-a43d-2578da20f579 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:42.720509 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5b47e92d-879f-4937-a43d-2578da20f579 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:42.721176 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5b47e92d-879f-4937-a43d-2578da20f579 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:42.721642 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5b47e92d-879f-4937-a43d-2578da20f579 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:42.765645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c2a47de8-a362-4078-8235-f9901b699a40 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:42.780344 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c2a47de8-a362-4078-8235-f9901b699a40 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1708 microversion: 2.1 time: 0.951751 May 16 19:10:42.806558 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 191/370] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:41 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1708 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:42.845520 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-52bdf578-fed6-4e41-9d1d-f82fdf69a8a6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:42.846506 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-52bdf578-fed6-4e41-9d1d-f82fdf69a8a6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:42.858897 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-52bdf578-fed6-4e41-9d1d-f82fdf69a8a6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:42.859521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-52bdf578-fed6-4e41-9d1d-f82fdf69a8a6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:42.860516 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-52bdf578-fed6-4e41-9d1d-f82fdf69a8a6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:42.860946 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-52bdf578-fed6-4e41-9d1d-f82fdf69a8a6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:42.956322 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-5b47e92d-879f-4937-a43d-2578da20f579 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:42.981018 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-5b47e92d-879f-4937-a43d-2578da20f579 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1500 microversion: 2.1 time: 0.291715 May 16 19:10:42.983076 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 180/371] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:42 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1500 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:42.991074 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-3b1ef734-7e56-42c2-8347-c076e19b550f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:42.992267 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-3b1ef734-7e56-42c2-8347-c076e19b550f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:43.016952 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3b1ef734-7e56-42c2-8347-c076e19b550f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:43.018138 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3b1ef734-7e56-42c2-8347-c076e19b550f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:43.019142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3b1ef734-7e56-42c2-8347-c076e19b550f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:43.020438 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3b1ef734-7e56-42c2-8347-c076e19b550f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:43.184728 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-3b1ef734-7e56-42c2-8347-c076e19b550f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:43.206412 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-3b1ef734-7e56-42c2-8347-c076e19b550f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1300 microversion: 2.1 time: 0.221709 May 16 19:10:43.207439 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 181/372] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:42 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1300 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:43.220904 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0408482b-6c12-4419-86a8-b0a9ffdb5bba tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f96aad09-0e80-4d1e-af57-e0e0a5547378"}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:43.229167 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0408482b-6c12-4419-86a8-b0a9ffdb5bba tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:43.238888 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0408482b-6c12-4419-86a8-b0a9ffdb5bba tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:43.239725 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0408482b-6c12-4419-86a8-b0a9ffdb5bba tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:43.240856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0408482b-6c12-4419-86a8-b0a9ffdb5bba tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:43.241689 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0408482b-6c12-4419-86a8-b0a9ffdb5bba tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:43.283399 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-0408482b-6c12-4419-86a8-b0a9ffdb5bba tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] HTTP exception thrown: Cannot 'attach_volume' instance 9cc4667a-a2c3-459c-ac05-45720bc0f622 while it is in vm_state rescued May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0408482b-6c12-4419-86a8-b0a9ffdb5bba tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Request method failure captured: May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: POST /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622/os-volume_attachments HTTP/1.1 May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 74 May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqEpTPlBWWpGAb8naoUtmT0kghhiI3kimMzn0_IWG3sCJkSvB5xO-7IGvOFSSINkqC-urNwmtwl2u96aKU3xl-Dex2fmV-bVO4ktBC40rbYPJQDH7eWDNSupKRIkwS3ds8fzriCvEWSDHbsHMvvS0L95hwszzciSeDbpHSrW4xtsOro May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: ba2c6e5fee5b402fa68833228d12c8e7 May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-949694738 May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:10:43.286060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:10:43.287456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:10:43.287456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-ServerRescueNegativeTestJSON-949694738 May 16 19:10:43.287456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: ba2c6e5fee5b402fa68833228d12c8e7 May 16 19:10:43.287456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-949694738 May 16 19:10:43.287456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-ServerRescueNegativeTestJSON-949694738-project May 16 19:10:43.287456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:10:43.287456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:10:43.287456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 1673e91c8910435499a5d587f4ef59f9 May 16 19:10:43.287456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-ServerRescueNegativeTestJSON-949694738-project May 16 19:10:43.287456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: May 16 19:10:43.287456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {"volumeAttachment": {"volumeId": "f96aad09-0e80-4d1e-af57-e0e0a5547378"}} May 16 19:10:43.287456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Cannot 'attach_volume' instance 9cc4667a-a2c3-459c-ac05-45720bc0f622 while it is in vm_state rescued May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'server_id': '9cc4667a-a2c3-459c-ac05-45720bc0f622', 'body': {'volumeAttachment': {'volumeId': 'f96aad09-0e80-4d1e-af57-e0e0a5547378'}}} May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9cc4667a-a2c3-459c-ac05-45720bc0f622 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:10:43.288257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9cc4667a-a2c3-459c-ac05-45720bc0f622 while it is in vm_state rescued May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:10:43.289405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:10:43.290616 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:10:43.290616 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:10:43.290616 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9cc4667a-a2c3-459c-ac05-45720bc0f622 while it is in vm_state rescued May 16 19:10:43.290616 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:10:43.295108 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0408482b-6c12-4419-86a8-b0a9ffdb5bba tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Returning 409 to user: Cannot 'attach_volume' instance 9cc4667a-a2c3-459c-ac05-45720bc0f622 while it is in vm_state rescued {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:10:43.296445 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0408482b-6c12-4419-86a8-b0a9ffdb5bba tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "POST /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.081904 May 16 19:10:43.301391 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 182/373] 10.222.0.24 () {60 vars in 1322 bytes} [Mon May 16 19:10:43 2022] POST /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622/os-volume_attachments => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 16 19:10:43.312399 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-eeb123b3-28d4-4922-badd-6f6e5720ee5f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:43.313321 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-eeb123b3-28d4-4922-badd-6f6e5720ee5f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:43.322640 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-eeb123b3-28d4-4922-badd-6f6e5720ee5f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:43.323494 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-eeb123b3-28d4-4922-badd-6f6e5720ee5f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:43.324842 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-eeb123b3-28d4-4922-badd-6f6e5720ee5f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:43.325521 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-eeb123b3-28d4-4922-badd-6f6e5720ee5f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:43.459123 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-eeb123b3-28d4-4922-badd-6f6e5720ee5f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "POST /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622/action" status: 202 len: 0 microversion: 2.1 time: 0.156084 May 16 19:10:43.463620 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 183/374] 10.222.0.24 () {60 vars in 1277 bytes} [Mon May 16 19:10:43 2022] POST /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:10:43.470006 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ee42a69f-06d1-4545-a6e0-f8396b45f932 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:43.470438 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ee42a69f-06d1-4545-a6e0-f8396b45f932 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:43.503743 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ee42a69f-06d1-4545-a6e0-f8396b45f932 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:43.504200 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ee42a69f-06d1-4545-a6e0-f8396b45f932 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:43.517962 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ee42a69f-06d1-4545-a6e0-f8396b45f932 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:43.518387 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ee42a69f-06d1-4545-a6e0-f8396b45f932 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:43.847129 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ee42a69f-06d1-4545-a6e0-f8396b45f932 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:43.856710 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ee42a69f-06d1-4545-a6e0-f8396b45f932 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1508 microversion: 2.1 time: 0.391731 May 16 19:10:43.857296 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 184/375] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:43 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1508 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:43.881651 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-013fb55b-e97b-4c5b-bb33-6ebcae37733d tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:43.882290 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-013fb55b-e97b-4c5b-bb33-6ebcae37733d tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:43.896684 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-013fb55b-e97b-4c5b-bb33-6ebcae37733d tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:43.902050 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-013fb55b-e97b-4c5b-bb33-6ebcae37733d tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:43.903112 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-013fb55b-e97b-4c5b-bb33-6ebcae37733d tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:43.903571 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-013fb55b-e97b-4c5b-bb33-6ebcae37733d tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:44.138922 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-013fb55b-e97b-4c5b-bb33-6ebcae37733d tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:44.148911 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-013fb55b-e97b-4c5b-bb33-6ebcae37733d tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1358 microversion: 2.1 time: 0.276095 May 16 19:10:44.150269 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 185/376] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:43 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:44.155849 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8885e4e6-8530-494f-92c8-cff606c25dd9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:44.156850 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8885e4e6-8530-494f-92c8-cff606c25dd9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:44.165433 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8885e4e6-8530-494f-92c8-cff606c25dd9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:44.172909 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8885e4e6-8530-494f-92c8-cff606c25dd9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:44.174293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8885e4e6-8530-494f-92c8-cff606c25dd9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:44.176094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8885e4e6-8530-494f-92c8-cff606c25dd9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:44.200504 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-52bdf578-fed6-4e41-9d1d-f82fdf69a8a6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:44.235517 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-52bdf578-fed6-4e41-9d1d-f82fdf69a8a6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:44.238546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-52bdf578-fed6-4e41-9d1d-f82fdf69a8a6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:44.244898 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-52bdf578-fed6-4e41-9d1d-f82fdf69a8a6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1740 microversion: 2.20 time: 1.402910 May 16 19:10:44.258949 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 192/377] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:42 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1740 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:10:44.266378 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0b9462c0-ca58-4cd8-a21c-d157028cc687 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:44.267903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0b9462c0-ca58-4cd8-a21c-d157028cc687 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:44.276163 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0b9462c0-ca58-4cd8-a21c-d157028cc687 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:44.276883 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0b9462c0-ca58-4cd8-a21c-d157028cc687 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:44.277949 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0b9462c0-ca58-4cd8-a21c-d157028cc687 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:44.278576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0b9462c0-ca58-4cd8-a21c-d157028cc687 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:44.509164 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-8885e4e6-8530-494f-92c8-cff606c25dd9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:44.523808 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8885e4e6-8530-494f-92c8-cff606c25dd9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.372002 May 16 19:10:44.529937 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 186/378] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:44 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:44.553655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-ae013582-0619-49d7-b554-bfb15f289cb5 req-8a0b2c91-d79d-4ccd-86df-d6890532a605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0298bd-7166-4b67-acf1-794621e95cdf", "name": "network-vif-plugged", "status": "completed", "tag": "12358361-c4bc-4509-98f8-117b7fd4543e"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:44.566850 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-ae013582-0619-49d7-b554-bfb15f289cb5 req-8a0b2c91-d79d-4ccd-86df-d6890532a605 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:44.567484 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-ae013582-0619-49d7-b554-bfb15f289cb5 req-8a0b2c91-d79d-4ccd-86df-d6890532a605 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:44.582800 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-ae013582-0619-49d7-b554-bfb15f289cb5 req-8a0b2c91-d79d-4ccd-86df-d6890532a605 service nova] Creating event network-vif-plugged:12358361-c4bc-4509-98f8-117b7fd4543e for instance 1e0298bd-7166-4b67-acf1-794621e95cdf on hv-cinder-76606 May 16 19:10:44.590015 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-ae013582-0619-49d7-b554-bfb15f289cb5 req-8a0b2c91-d79d-4ccd-86df-d6890532a605 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048183 May 16 19:10:44.590985 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 187/379] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:10:44.596689 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-754c8f4c-cc61-4ac0-a606-f08e42873e2b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:44.609620 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-754c8f4c-cc61-4ac0-a606-f08e42873e2b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:44.620237 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-754c8f4c-cc61-4ac0-a606-f08e42873e2b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:44.620649 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-754c8f4c-cc61-4ac0-a606-f08e42873e2b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:44.621501 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-754c8f4c-cc61-4ac0-a606-f08e42873e2b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:44.621959 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-754c8f4c-cc61-4ac0-a606-f08e42873e2b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:44.762987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-754c8f4c-cc61-4ac0-a606-f08e42873e2b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:44.783113 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-754c8f4c-cc61-4ac0-a606-f08e42873e2b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1300 microversion: 2.1 time: 0.188304 May 16 19:10:44.784149 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 188/380] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:44 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1300 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:44.879669 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7f28e3db-2122-4042-b0a7-ab5cf1245618 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:44.880505 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7f28e3db-2122-4042-b0a7-ab5cf1245618 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:44.890775 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7f28e3db-2122-4042-b0a7-ab5cf1245618 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:44.896966 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7f28e3db-2122-4042-b0a7-ab5cf1245618 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:44.898573 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7f28e3db-2122-4042-b0a7-ab5cf1245618 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:44.899316 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7f28e3db-2122-4042-b0a7-ab5cf1245618 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:45.098213 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7f28e3db-2122-4042-b0a7-ab5cf1245618 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:45.108581 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7f28e3db-2122-4042-b0a7-ab5cf1245618 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1508 microversion: 2.1 time: 0.237843 May 16 19:10:45.109433 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 189/381] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:44 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:45.166522 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-24bc0cda-98ff-4049-b782-c1c4e03f1bd5 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:45.167219 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-24bc0cda-98ff-4049-b782-c1c4e03f1bd5 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:45.173459 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-24bc0cda-98ff-4049-b782-c1c4e03f1bd5 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:45.174423 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-24bc0cda-98ff-4049-b782-c1c4e03f1bd5 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:45.175457 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-24bc0cda-98ff-4049-b782-c1c4e03f1bd5 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:45.176084 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-24bc0cda-98ff-4049-b782-c1c4e03f1bd5 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:45.429058 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-24bc0cda-98ff-4049-b782-c1c4e03f1bd5 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:45.443607 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-24bc0cda-98ff-4049-b782-c1c4e03f1bd5 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1358 microversion: 2.1 time: 0.280835 May 16 19:10:45.444195 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 190/382] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:45 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:45.456674 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f11927af-30b8-4a9d-8080-4d2d09438e2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:45.457295 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f11927af-30b8-4a9d-8080-4d2d09438e2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:45.475956 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f11927af-30b8-4a9d-8080-4d2d09438e2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:45.476414 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f11927af-30b8-4a9d-8080-4d2d09438e2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:45.477209 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f11927af-30b8-4a9d-8080-4d2d09438e2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:45.477669 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f11927af-30b8-4a9d-8080-4d2d09438e2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:45.523556 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0b9462c0-ca58-4cd8-a21c-d157028cc687 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:45.532941 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0b9462c0-ca58-4cd8-a21c-d157028cc687 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1708 microversion: 2.1 time: 1.272596 May 16 19:10:45.533517 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 193/383] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:44 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1708 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:45.562244 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ca3958d9-a38c-4019-86f5-2c98eae20224 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:45.563107 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ca3958d9-a38c-4019-86f5-2c98eae20224 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:45.576995 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ca3958d9-a38c-4019-86f5-2c98eae20224 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:45.577723 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ca3958d9-a38c-4019-86f5-2c98eae20224 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:45.579003 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ca3958d9-a38c-4019-86f5-2c98eae20224 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:45.579586 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ca3958d9-a38c-4019-86f5-2c98eae20224 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:45.878020 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f11927af-30b8-4a9d-8080-4d2d09438e2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:45.892428 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f11927af-30b8-4a9d-8080-4d2d09438e2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:45.895948 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f11927af-30b8-4a9d-8080-4d2d09438e2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:45.897193 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f11927af-30b8-4a9d-8080-4d2d09438e2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1740 microversion: 2.20 time: 0.451539 May 16 19:10:45.901298 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 191/384] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:45 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1740 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:45.906698 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-1c8a574e-8d67-43c0-a65e-d8abed57b954 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:45.907977 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-1c8a574e-8d67-43c0-a65e-d8abed57b954 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:45.916336 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1c8a574e-8d67-43c0-a65e-d8abed57b954 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:45.918884 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1c8a574e-8d67-43c0-a65e-d8abed57b954 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:45.919987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1c8a574e-8d67-43c0-a65e-d8abed57b954 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:45.920575 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1c8a574e-8d67-43c0-a65e-d8abed57b954 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:46.204980 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-1c8a574e-8d67-43c0-a65e-d8abed57b954 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:46.218762 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-1c8a574e-8d67-43c0-a65e-d8abed57b954 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1368 microversion: 2.1 time: 0.316102 May 16 19:10:46.220049 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 192/385] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:45 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1368 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:46.226545 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-cd85241e-7fa1-4df6-8520-8563b878bc72 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:46.228011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-cd85241e-7fa1-4df6-8520-8563b878bc72 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:46.241047 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cd85241e-7fa1-4df6-8520-8563b878bc72 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:46.241854 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cd85241e-7fa1-4df6-8520-8563b878bc72 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:46.242887 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cd85241e-7fa1-4df6-8520-8563b878bc72 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:46.244017 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cd85241e-7fa1-4df6-8520-8563b878bc72 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:46.489764 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-cd85241e-7fa1-4df6-8520-8563b878bc72 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:46.499879 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-cd85241e-7fa1-4df6-8520-8563b878bc72 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1508 microversion: 2.1 time: 0.277127 May 16 19:10:46.508215 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ca3958d9-a38c-4019-86f5-2c98eae20224 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:46.515149 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 193/386] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:46 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:46.523287 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ca3958d9-a38c-4019-86f5-2c98eae20224 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.978470 May 16 19:10:46.525034 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 194/387] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:45 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:46.527679 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ecf3ecb3-faba-4f0c-9ddb-789a81834d7b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:46.528364 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ecf3ecb3-faba-4f0c-9ddb-789a81834d7b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:46.545339 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ecf3ecb3-faba-4f0c-9ddb-789a81834d7b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:46.546079 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ecf3ecb3-faba-4f0c-9ddb-789a81834d7b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:46.547049 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ecf3ecb3-faba-4f0c-9ddb-789a81834d7b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:46.548815 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ecf3ecb3-faba-4f0c-9ddb-789a81834d7b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:46.550925 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ee0c33ba-fad9-44bc-b13b-e098fdb3b8a9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:46.551714 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ee0c33ba-fad9-44bc-b13b-e098fdb3b8a9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:46.571671 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ee0c33ba-fad9-44bc-b13b-e098fdb3b8a9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:46.572415 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ee0c33ba-fad9-44bc-b13b-e098fdb3b8a9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:46.573383 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ee0c33ba-fad9-44bc-b13b-e098fdb3b8a9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:46.573999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ee0c33ba-fad9-44bc-b13b-e098fdb3b8a9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:46.765395 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ecf3ecb3-faba-4f0c-9ddb-789a81834d7b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:46.780696 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ecf3ecb3-faba-4f0c-9ddb-789a81834d7b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1358 microversion: 2.1 time: 0.263622 May 16 19:10:46.781981 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 194/388] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:46 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:46.918498 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-31adc15e-0db2-4722-b400-23b64a3f0905 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:46.918498 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-31adc15e-0db2-4722-b400-23b64a3f0905 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:46.924965 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-31adc15e-0db2-4722-b400-23b64a3f0905 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:46.935048 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-31adc15e-0db2-4722-b400-23b64a3f0905 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:46.939363 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-31adc15e-0db2-4722-b400-23b64a3f0905 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:46.939820 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-31adc15e-0db2-4722-b400-23b64a3f0905 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:47.116244 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-31adc15e-0db2-4722-b400-23b64a3f0905 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:47.130630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-31adc15e-0db2-4722-b400-23b64a3f0905 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:47.132904 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-31adc15e-0db2-4722-b400-23b64a3f0905 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:47.134429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-31adc15e-0db2-4722-b400-23b64a3f0905 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1740 microversion: 2.20 time: 0.220838 May 16 19:10:47.145976 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 195/389] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:46 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1740 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:47.237501 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b2d9989e-2111-4561-a4d8-e065376e7537 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:47.238890 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b2d9989e-2111-4561-a4d8-e065376e7537 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:47.252654 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ee0c33ba-fad9-44bc-b13b-e098fdb3b8a9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:47.256566 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b2d9989e-2111-4561-a4d8-e065376e7537 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:47.257328 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b2d9989e-2111-4561-a4d8-e065376e7537 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:47.258366 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b2d9989e-2111-4561-a4d8-e065376e7537 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:47.259018 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b2d9989e-2111-4561-a4d8-e065376e7537 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:47.274737 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ee0c33ba-fad9-44bc-b13b-e098fdb3b8a9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1712 microversion: 2.1 time: 0.722530 May 16 19:10:47.289353 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 195/390] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:46 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1712 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:47.452232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b2d9989e-2111-4561-a4d8-e065376e7537 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:47.465758 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b2d9989e-2111-4561-a4d8-e065376e7537 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1368 microversion: 2.1 time: 0.232736 May 16 19:10:47.473748 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 196/391] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:47 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:47.519052 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b4594b15-bd9e-4974-8449-a3077b64336c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:47.520371 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b4594b15-bd9e-4974-8449-a3077b64336c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:47.531960 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b4594b15-bd9e-4974-8449-a3077b64336c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:47.533129 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b4594b15-bd9e-4974-8449-a3077b64336c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:47.544416 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-1bdcfc43-c0cb-4ed3-b045-e9f37b8db782 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:47.544416 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-1bdcfc43-c0cb-4ed3-b045-e9f37b8db782 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:47.549939 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b4594b15-bd9e-4974-8449-a3077b64336c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:47.550931 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b4594b15-bd9e-4974-8449-a3077b64336c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:47.551777 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1bdcfc43-c0cb-4ed3-b045-e9f37b8db782 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:47.552232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1bdcfc43-c0cb-4ed3-b045-e9f37b8db782 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:47.553022 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1bdcfc43-c0cb-4ed3-b045-e9f37b8db782 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:47.553455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1bdcfc43-c0cb-4ed3-b045-e9f37b8db782 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:47.753909 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-1bdcfc43-c0cb-4ed3-b045-e9f37b8db782 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:47.763782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-1bdcfc43-c0cb-4ed3-b045-e9f37b8db782 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.226953 May 16 19:10:47.765702 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 197/392] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:47 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:47.800211 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-76b3bf83-2d5c-4b7f-afa4-a285aec055cd tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:47.801131 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-76b3bf83-2d5c-4b7f-afa4-a285aec055cd tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:47.810982 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-76b3bf83-2d5c-4b7f-afa4-a285aec055cd tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:47.811679 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-76b3bf83-2d5c-4b7f-afa4-a285aec055cd tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:47.812175 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-76b3bf83-2d5c-4b7f-afa4-a285aec055cd tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:47.813434 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-76b3bf83-2d5c-4b7f-afa4-a285aec055cd tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:48.034213 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-76b3bf83-2d5c-4b7f-afa4-a285aec055cd tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:48.043881 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-76b3bf83-2d5c-4b7f-afa4-a285aec055cd tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1548 microversion: 2.1 time: 0.249505 May 16 19:10:48.045228 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 198/393] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:47 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1548 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:48.050257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-087f6f9e-738b-4bb3-90b7-bd18f12e6878 req-5b6834e9-341a-40de-b897-b8ec739d44b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eee5cef-ceca-43ee-8c12-060886550585", "tag": "64315f99-6584-4888-bfb0-c3b32c4b2501"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:48.060025 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-087f6f9e-738b-4bb3-90b7-bd18f12e6878 req-5b6834e9-341a-40de-b897-b8ec739d44b5 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:48.060872 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-087f6f9e-738b-4bb3-90b7-bd18f12e6878 req-5b6834e9-341a-40de-b897-b8ec739d44b5 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:48.076353 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-087f6f9e-738b-4bb3-90b7-bd18f12e6878 req-5b6834e9-341a-40de-b897-b8ec739d44b5 service nova] Creating event network-changed:64315f99-6584-4888-bfb0-c3b32c4b2501 for instance 6eee5cef-ceca-43ee-8c12-060886550585 on hv-cinder-76606 May 16 19:10:48.085320 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-087f6f9e-738b-4bb3-90b7-bd18f12e6878 req-5b6834e9-341a-40de-b897-b8ec739d44b5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038587 May 16 19:10:48.095459 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 199/394] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:10:48.101193 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-42d277fe-d6d7-4bd6-8efa-8e9cc74442c8 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:48.102290 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-42d277fe-d6d7-4bd6-8efa-8e9cc74442c8 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:48.109349 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-42d277fe-d6d7-4bd6-8efa-8e9cc74442c8 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:48.110172 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-42d277fe-d6d7-4bd6-8efa-8e9cc74442c8 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:48.111180 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-42d277fe-d6d7-4bd6-8efa-8e9cc74442c8 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:48.111856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-42d277fe-d6d7-4bd6-8efa-8e9cc74442c8 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:48.275024 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b4594b15-bd9e-4974-8449-a3077b64336c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:48.288004 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b4594b15-bd9e-4974-8449-a3077b64336c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1508 microversion: 2.1 time: 0.775097 May 16 19:10:48.288455 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 196/395] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:47 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1508 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:48.302981 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-70ffa30f-a6b3-4b6f-8d11-6e081bb633d4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:48.303585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-70ffa30f-a6b3-4b6f-8d11-6e081bb633d4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:48.326217 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-70ffa30f-a6b3-4b6f-8d11-6e081bb633d4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:48.327001 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-70ffa30f-a6b3-4b6f-8d11-6e081bb633d4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:48.328525 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-70ffa30f-a6b3-4b6f-8d11-6e081bb633d4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:48.329197 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-70ffa30f-a6b3-4b6f-8d11-6e081bb633d4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:48.352175 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-42d277fe-d6d7-4bd6-8efa-8e9cc74442c8 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:48.362559 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-42d277fe-d6d7-4bd6-8efa-8e9cc74442c8 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1548 microversion: 2.1 time: 0.265485 May 16 19:10:48.363792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 200/396] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:48 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1548 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:48.384618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4759c4eb-5306-4a97-ba53-3d3f475dedb7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:48.388780 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4759c4eb-5306-4a97-ba53-3d3f475dedb7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:48.389573 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-4759c4eb-5306-4a97-ba53-3d3f475dedb7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Searching by: {'deleted': False, 'project_id': '84949fef3a77459fbf02d0804bafdc4a'} {{(pid=117274) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 16 19:10:48.397124 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4759c4eb-5306-4a97-ba53-3d3f475dedb7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:48.397589 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4759c4eb-5306-4a97-ba53-3d3f475dedb7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:48.398930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4759c4eb-5306-4a97-ba53-3d3f475dedb7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:48.399375 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4759c4eb-5306-4a97-ba53-3d3f475dedb7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:48.541678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.multi_cell_list [None req-4759c4eb-5306-4a97-ba53-3d3f475dedb7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117274) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 16 19:10:48.659754 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4759c4eb-5306-4a97-ba53-3d3f475dedb7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.279669 May 16 19:10:48.660665 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 201/397] 10.222.0.24 () {58 vars in 1124 bytes} [Mon May 16 19:10:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:10:48.671051 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-abdd90da-a7e5-410d-a7f0-820b9e7874c0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:48.671667 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-abdd90da-a7e5-410d-a7f0-820b9e7874c0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:48.688312 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-abdd90da-a7e5-410d-a7f0-820b9e7874c0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:48.688770 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-abdd90da-a7e5-410d-a7f0-820b9e7874c0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:48.689591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-abdd90da-a7e5-410d-a7f0-820b9e7874c0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:48.690027 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-abdd90da-a7e5-410d-a7f0-820b9e7874c0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:48.868289 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-abdd90da-a7e5-410d-a7f0-820b9e7874c0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:48.878056 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-abdd90da-a7e5-410d-a7f0-820b9e7874c0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1368 microversion: 2.1 time: 0.216261 May 16 19:10:48.878649 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 202/398] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:48 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:48.883839 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b6b76265-2263-45c6-9d1b-3093fa32690a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:48.884461 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b6b76265-2263-45c6-9d1b-3093fa32690a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:48.891406 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b6b76265-2263-45c6-9d1b-3093fa32690a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:48.891623 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b6b76265-2263-45c6-9d1b-3093fa32690a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:48.893379 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b6b76265-2263-45c6-9d1b-3093fa32690a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:48.894110 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b6b76265-2263-45c6-9d1b-3093fa32690a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:49.079215 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b6b76265-2263-45c6-9d1b-3093fa32690a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:49.090297 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b6b76265-2263-45c6-9d1b-3093fa32690a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1548 microversion: 2.1 time: 0.210101 May 16 19:10:49.091322 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 203/399] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:48 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1548 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:49.096009 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8c93ea63-49ed-4764-9221-2ac3fa2e5835 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:49.096922 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8c93ea63-49ed-4764-9221-2ac3fa2e5835 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:49.125707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c93ea63-49ed-4764-9221-2ac3fa2e5835 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:49.126511 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c93ea63-49ed-4764-9221-2ac3fa2e5835 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:49.128256 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c93ea63-49ed-4764-9221-2ac3fa2e5835 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:49.129765 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c93ea63-49ed-4764-9221-2ac3fa2e5835 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:49.231674 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-70ffa30f-a6b3-4b6f-8d11-6e081bb633d4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:49.244177 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-70ffa30f-a6b3-4b6f-8d11-6e081bb633d4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:49.249145 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-70ffa30f-a6b3-4b6f-8d11-6e081bb633d4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:49.253027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-70ffa30f-a6b3-4b6f-8d11-6e081bb633d4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1740 microversion: 2.20 time: 0.953873 May 16 19:10:49.256435 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 197/400] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:48 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1740 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:49.304282 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d1e3917e-5494-4700-98ff-5a6302a2bab9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:49.305188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d1e3917e-5494-4700-98ff-5a6302a2bab9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:49.316515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1e3917e-5494-4700-98ff-5a6302a2bab9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:49.317378 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1e3917e-5494-4700-98ff-5a6302a2bab9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:49.320684 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1e3917e-5494-4700-98ff-5a6302a2bab9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:49.325511 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1e3917e-5494-4700-98ff-5a6302a2bab9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:49.528891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-8c93ea63-49ed-4764-9221-2ac3fa2e5835 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:49.539748 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8c93ea63-49ed-4764-9221-2ac3fa2e5835 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.447069 May 16 19:10:49.540479 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 204/401] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:49 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:49.870397 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d1e3917e-5494-4700-98ff-5a6302a2bab9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:49.882508 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d1e3917e-5494-4700-98ff-5a6302a2bab9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1508 microversion: 2.1 time: 0.581953 May 16 19:10:49.900169 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 198/402] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:49 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1508 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:49.901554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-bf91edcc-167b-466f-b0f3-34b0d80426a5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:49.902417 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-bf91edcc-167b-466f-b0f3-34b0d80426a5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:49.925036 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bf91edcc-167b-466f-b0f3-34b0d80426a5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:49.925036 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bf91edcc-167b-466f-b0f3-34b0d80426a5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:49.925036 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bf91edcc-167b-466f-b0f3-34b0d80426a5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:49.925036 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bf91edcc-167b-466f-b0f3-34b0d80426a5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:50.193566 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-bf91edcc-167b-466f-b0f3-34b0d80426a5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:50.203535 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-bf91edcc-167b-466f-b0f3-34b0d80426a5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1368 microversion: 2.1 time: 0.307147 May 16 19:10:50.205662 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 205/403] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:49 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1368 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:50.233448 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-c7a3b168-36b0-4b3b-8aae-a00ee9ae45a1 req-58f5689d-b84f-4618-94ba-8c005db3207c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73fbf87a-3557-408c-ac54-e6ca9017a0f1", "tag": "4c82ce8d-f16a-4001-99f0-aa83af3c4315"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:50.266708 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-c7a3b168-36b0-4b3b-8aae-a00ee9ae45a1 req-58f5689d-b84f-4618-94ba-8c005db3207c service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:50.267209 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-c7a3b168-36b0-4b3b-8aae-a00ee9ae45a1 req-58f5689d-b84f-4618-94ba-8c005db3207c service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:50.311247 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-c7a3b168-36b0-4b3b-8aae-a00ee9ae45a1 req-58f5689d-b84f-4618-94ba-8c005db3207c service nova] Creating event network-changed:4c82ce8d-f16a-4001-99f0-aa83af3c4315 for instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 on hv-cinder-76606 May 16 19:10:50.324390 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-c7a3b168-36b0-4b3b-8aae-a00ee9ae45a1 req-58f5689d-b84f-4618-94ba-8c005db3207c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108166 May 16 19:10:50.325204 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 206/404] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:10:50.331884 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-57db2e21-fd46-4323-9823-be759d6d15e4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:50.332580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-57db2e21-fd46-4323-9823-be759d6d15e4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:50.351771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-57db2e21-fd46-4323-9823-be759d6d15e4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:50.352595 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-57db2e21-fd46-4323-9823-be759d6d15e4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:50.356170 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-57db2e21-fd46-4323-9823-be759d6d15e4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:50.358129 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-57db2e21-fd46-4323-9823-be759d6d15e4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:50.542344 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9b6030a6-a5e2-4172-b89b-11abe39b27ba tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Action: 'create', calling method: .version_select at 0x7f1e18056160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1526048130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz+wXf1Yt//aMm2nhk7pOr2JktzUJ4J8HHcyvnsF4zyDFekqaAUHyr2CpMvVRegt6nPzTaUDG3D1qIJqPM6o8J91dHaj1v1Q/vzKpx7gAjC1y17T52/+z2oT89VqH4Yyw=="}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:50.543295 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-57db2e21-fd46-4323-9823-be759d6d15e4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:50.553567 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-57db2e21-fd46-4323-9823-be759d6d15e4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:50.555241 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-57db2e21-fd46-4323-9823-be759d6d15e4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:50.556677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-57db2e21-fd46-4323-9823-be759d6d15e4 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1740 microversion: 2.20 time: 0.230573 May 16 19:10:50.557455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 207/405] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:50 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:50.576347 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2e239c63-43a5-4c89-a73e-ccfc73ef3721 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:50.586622 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-9b6030a6-a5e2-4172-b89b-11abe39b27ba tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Getting quotas for project 5e758da8d71142bdbac8765efccefde8. Resources: {'key_pairs'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:10:50.591648 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2e239c63-43a5-4c89-a73e-ccfc73ef3721 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:50.593084 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-9b6030a6-a5e2-4172-b89b-11abe39b27ba tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Getting quotas for user 16afce4f51384e37b381171cbc2e0a82 and project 5e758da8d71142bdbac8765efccefde8. Resources: {'key_pairs'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:10:50.613206 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2e239c63-43a5-4c89-a73e-ccfc73ef3721 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:50.614337 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2e239c63-43a5-4c89-a73e-ccfc73ef3721 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:50.618477 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2e239c63-43a5-4c89-a73e-ccfc73ef3721 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:50.618930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2e239c63-43a5-4c89-a73e-ccfc73ef3721 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:50.645317 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9b6030a6-a5e2-4172-b89b-11abe39b27ba tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.536948 May 16 19:10:50.646621 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 199/406] 10.222.0.24 () {60 vars in 1158 bytes} [Mon May 16 19:10:50 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:10:50.903896 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-22bd105b-781b-4ccd-a10d-93d9f961c722 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:50.904884 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-22bd105b-781b-4ccd-a10d-93d9f961c722 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:50.915540 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-22bd105b-781b-4ccd-a10d-93d9f961c722 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:50.917587 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-22bd105b-781b-4ccd-a10d-93d9f961c722 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:50.919398 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-22bd105b-781b-4ccd-a10d-93d9f961c722 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:50.922840 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-22bd105b-781b-4ccd-a10d-93d9f961c722 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:51.027197 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2e239c63-43a5-4c89-a73e-ccfc73ef3721 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:51.050756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2e239c63-43a5-4c89-a73e-ccfc73ef3721 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.489786 May 16 19:10:51.053020 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 208/407] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:50 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:51.226845 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-747e1a18-457e-4b35-9d18-38372c8511cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:51.227685 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-747e1a18-457e-4b35-9d18-38372c8511cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:51.256761 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-747e1a18-457e-4b35-9d18-38372c8511cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:51.257855 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-747e1a18-457e-4b35-9d18-38372c8511cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:51.259554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-747e1a18-457e-4b35-9d18-38372c8511cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:51.263740 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-747e1a18-457e-4b35-9d18-38372c8511cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:51.483012 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-22bd105b-781b-4ccd-a10d-93d9f961c722 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:51.496226 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-22bd105b-781b-4ccd-a10d-93d9f961c722 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1514 microversion: 2.1 time: 0.595643 May 16 19:10:51.503734 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 200/408] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:50 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1514 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:51.524093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-bcad2dad-3e2a-48ce-ad21-21d3b97ae8a3 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c5f7867-5cca-4b95-979a-60df47a25fbb"}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:51.530199 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-bcad2dad-3e2a-48ce-ad21-21d3b97ae8a3 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:51.551340 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bcad2dad-3e2a-48ce-ad21-21d3b97ae8a3 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:51.559605 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bcad2dad-3e2a-48ce-ad21-21d3b97ae8a3 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:51.560754 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bcad2dad-3e2a-48ce-ad21-21d3b97ae8a3 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:51.564003 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bcad2dad-3e2a-48ce-ad21-21d3b97ae8a3 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:51.593343 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-747e1a18-457e-4b35-9d18-38372c8511cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:51.603649 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-747e1a18-457e-4b35-9d18-38372c8511cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1368 microversion: 2.1 time: 0.385882 May 16 19:10:51.614519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 209/409] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:51 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1368 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:51.620107 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a6decf38-d404-427d-8342-d0100711d94a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:51.621106 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a6decf38-d404-427d-8342-d0100711d94a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:51.628149 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a6decf38-d404-427d-8342-d0100711d94a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:51.629037 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a6decf38-d404-427d-8342-d0100711d94a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:51.630127 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a6decf38-d404-427d-8342-d0100711d94a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:51.630768 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a6decf38-d404-427d-8342-d0100711d94a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:51.987607 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a6decf38-d404-427d-8342-d0100711d94a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:52.000068 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a6decf38-d404-427d-8342-d0100711d94a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:52.004959 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a6decf38-d404-427d-8342-d0100711d94a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:52.008414 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a6decf38-d404-427d-8342-d0100711d94a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1740 microversion: 2.20 time: 0.392076 May 16 19:10:52.023182 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 210/410] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:51 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1740 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:52.068754 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5ccb567f-4618-4d6d-955b-190fcda33ed4 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:52.069571 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5ccb567f-4618-4d6d-955b-190fcda33ed4 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:52.088436 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5ccb567f-4618-4d6d-955b-190fcda33ed4 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:52.088964 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5ccb567f-4618-4d6d-955b-190fcda33ed4 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:52.089863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5ccb567f-4618-4d6d-955b-190fcda33ed4 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:52.093618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5ccb567f-4618-4d6d-955b-190fcda33ed4 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:52.494936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-5ccb567f-4618-4d6d-955b-190fcda33ed4 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:52.516609 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-5ccb567f-4618-4d6d-955b-190fcda33ed4 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.451613 May 16 19:10:52.517023 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 211/411] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:52 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:52.621985 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d453d90e-3946-440e-8f63-fb24c6af22ec tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:52.622773 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d453d90e-3946-440e-8f63-fb24c6af22ec tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:52.635507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d453d90e-3946-440e-8f63-fb24c6af22ec tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:52.636085 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d453d90e-3946-440e-8f63-fb24c6af22ec tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:52.636957 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d453d90e-3946-440e-8f63-fb24c6af22ec tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:52.637396 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d453d90e-3946-440e-8f63-fb24c6af22ec tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:52.948659 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d453d90e-3946-440e-8f63-fb24c6af22ec tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:52.958058 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d453d90e-3946-440e-8f63-fb24c6af22ec tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1368 microversion: 2.1 time: 0.340357 May 16 19:10:52.962806 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 212/412] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:52 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1368 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:53.030231 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-722928c9-ceee-4b9a-a404-2daff5cb648c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:53.031058 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-722928c9-ceee-4b9a-a404-2daff5cb648c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:53.051662 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-722928c9-ceee-4b9a-a404-2daff5cb648c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:53.051662 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-722928c9-ceee-4b9a-a404-2daff5cb648c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:53.051662 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-722928c9-ceee-4b9a-a404-2daff5cb648c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:53.051662 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-722928c9-ceee-4b9a-a404-2daff5cb648c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:53.337401 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-722928c9-ceee-4b9a-a404-2daff5cb648c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:53.347842 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-722928c9-ceee-4b9a-a404-2daff5cb648c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:53.348832 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-722928c9-ceee-4b9a-a404-2daff5cb648c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:53.350025 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-722928c9-ceee-4b9a-a404-2daff5cb648c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1740 microversion: 2.20 time: 0.324701 May 16 19:10:53.353684 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 213/413] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:53 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1740 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:53.369092 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8892ddf1-73f2-472c-8348-d345f4cbf749 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Action: 'create', calling method: .version_select at 0x7f1e1906a4c0>, body: {"keypair": {"name": "tempest-keypair-1726969247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKv2DGuXXG511i9DYyQZRzKUvmNBcLtZiCLgaE/Q2Y9/0E0lu09rGtygKXlTsaAIw1w6EAOkyoSIUjuMzulMvrBymf6aoQOu1p+YuTSjEX0jq2hARp/tzRhaYkTPmOYlqg=="}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:53.406474 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-8892ddf1-73f2-472c-8348-d345f4cbf749 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Getting quotas for project ba2c6e5fee5b402fa68833228d12c8e7. Resources: {'key_pairs'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:10:53.412820 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-8892ddf1-73f2-472c-8348-d345f4cbf749 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Getting quotas for user 1673e91c8910435499a5d587f4ef59f9 and project ba2c6e5fee5b402fa68833228d12c8e7. Resources: {'key_pairs'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:10:53.515653 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8892ddf1-73f2-472c-8348-d345f4cbf749 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.163387 May 16 19:10:53.516559 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 214/414] 10.222.0.24 () {60 vars in 1158 bytes} [Mon May 16 19:10:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:10:53.534492 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e5d319b9-23b0-4e0c-a242-6c304d5e602f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:53.535288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e5d319b9-23b0-4e0c-a242-6c304d5e602f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:53.553117 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5d319b9-23b0-4e0c-a242-6c304d5e602f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:53.553890 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5d319b9-23b0-4e0c-a242-6c304d5e602f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:53.565103 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5d319b9-23b0-4e0c-a242-6c304d5e602f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:53.565592 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5d319b9-23b0-4e0c-a242-6c304d5e602f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:53.976104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-bcad2dad-3e2a-48ce-ad21-21d3b97ae8a3 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "POST /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.469459 May 16 19:10:53.982854 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 201/415] 10.222.0.24 () {60 vars in 1322 bytes} [Mon May 16 19:10:51 2022] POST /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/os-volume_attachments => generated 194 bytes in 2478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:10:53.992194 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-70da91df-8fba-425b-873a-cf28be704c7a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:53.993662 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-70da91df-8fba-425b-873a-cf28be704c7a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:54.001518 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-70da91df-8fba-425b-873a-cf28be704c7a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:54.002376 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-70da91df-8fba-425b-873a-cf28be704c7a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:54.003499 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-70da91df-8fba-425b-873a-cf28be704c7a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:54.004104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-70da91df-8fba-425b-873a-cf28be704c7a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:54.108423 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e5d319b9-23b0-4e0c-a242-6c304d5e602f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:54.127677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e5d319b9-23b0-4e0c-a242-6c304d5e602f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.597170 May 16 19:10:54.128587 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 215/416] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:53 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:54.369340 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-36e62f61-06a7-430e-87fa-b93c21c9a6b2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:54.369990 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-36e62f61-06a7-430e-87fa-b93c21c9a6b2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:54.380074 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-36e62f61-06a7-430e-87fa-b93c21c9a6b2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:54.380526 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-36e62f61-06a7-430e-87fa-b93c21c9a6b2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:54.390429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-36e62f61-06a7-430e-87fa-b93c21c9a6b2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:54.394658 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-36e62f61-06a7-430e-87fa-b93c21c9a6b2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:54.401727 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-70da91df-8fba-425b-873a-cf28be704c7a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:54.410141 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-70da91df-8fba-425b-873a-cf28be704c7a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1368 microversion: 2.1 time: 0.425678 May 16 19:10:54.420743 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 202/417] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:53 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1368 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:54.766267 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-36e62f61-06a7-430e-87fa-b93c21c9a6b2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:54.780085 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-36e62f61-06a7-430e-87fa-b93c21c9a6b2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:54.785695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-36e62f61-06a7-430e-87fa-b93c21c9a6b2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:54.788277 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-36e62f61-06a7-430e-87fa-b93c21c9a6b2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1740 microversion: 2.20 time: 0.423740 May 16 19:10:54.789339 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 216/418] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:54 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1740 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:10:55.145796 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-12edfb31-3da3-456a-a8d4-3db8cf74b830 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:55.146627 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-12edfb31-3da3-456a-a8d4-3db8cf74b830 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:55.161228 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-12edfb31-3da3-456a-a8d4-3db8cf74b830 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:55.161716 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-12edfb31-3da3-456a-a8d4-3db8cf74b830 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:55.163024 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-12edfb31-3da3-456a-a8d4-3db8cf74b830 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:55.163472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-12edfb31-3da3-456a-a8d4-3db8cf74b830 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:55.427217 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9855ba47-51d1-445a-b5d3-5278d4dd56ad tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:55.427834 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9855ba47-51d1-445a-b5d3-5278d4dd56ad tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:55.436952 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9855ba47-51d1-445a-b5d3-5278d4dd56ad tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:55.438638 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9855ba47-51d1-445a-b5d3-5278d4dd56ad tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:55.440564 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-12edfb31-3da3-456a-a8d4-3db8cf74b830 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:55.441459 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9855ba47-51d1-445a-b5d3-5278d4dd56ad tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:55.442907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9855ba47-51d1-445a-b5d3-5278d4dd56ad tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:55.453124 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-12edfb31-3da3-456a-a8d4-3db8cf74b830 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.312183 May 16 19:10:55.454734 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 203/419] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:55 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:55.727368 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9855ba47-51d1-445a-b5d3-5278d4dd56ad tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:55.738438 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9855ba47-51d1-445a-b5d3-5278d4dd56ad tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1368 microversion: 2.1 time: 0.314892 May 16 19:10:55.739065 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 217/420] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:55 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1368 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:55.808285 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-45434cb4-5752-449d-b8f8-b286fbe6f01c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:55.809278 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-45434cb4-5752-449d-b8f8-b286fbe6f01c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:55.816327 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-45434cb4-5752-449d-b8f8-b286fbe6f01c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:55.817885 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-45434cb4-5752-449d-b8f8-b286fbe6f01c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:55.819021 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-45434cb4-5752-449d-b8f8-b286fbe6f01c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:55.819679 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-45434cb4-5752-449d-b8f8-b286fbe6f01c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:56.017413 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-45434cb4-5752-449d-b8f8-b286fbe6f01c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:56.031233 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-45434cb4-5752-449d-b8f8-b286fbe6f01c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:56.033350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-45434cb4-5752-449d-b8f8-b286fbe6f01c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:56.036537 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-45434cb4-5752-449d-b8f8-b286fbe6f01c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1740 microversion: 2.20 time: 0.232136 May 16 19:10:56.049141 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 204/421] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:55 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:56.245432 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c7461366-de81-435b-a25d-73adb70bb04c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-466865785", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0160fa7-2bfb-4bc1-8d58-6361ff669d8e"}], "security_groups": [{"name": "tempest-securitygroup--646771102"}], "key_name": "tempest-keypair-1726969247", "user_data": "}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:56.470908 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3f9ca962-41b3-4768-89a9-19fc0c0f4409 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:56.472240 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-3f9ca962-41b3-4768-89a9-19fc0c0f4409 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:56.479195 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3f9ca962-41b3-4768-89a9-19fc0c0f4409 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:56.479859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3f9ca962-41b3-4768-89a9-19fc0c0f4409 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:56.483755 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3f9ca962-41b3-4768-89a9-19fc0c0f4409 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:56.484395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3f9ca962-41b3-4768-89a9-19fc0c0f4409 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:56.635973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-3f9ca962-41b3-4768-89a9-19fc0c0f4409 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:56.644209 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-3f9ca962-41b3-4768-89a9-19fc0c0f4409 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.177760 May 16 19:10:56.644993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 205/422] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:56 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:56.757558 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1caa0aa8-1fb5-494a-bf92-f5c8a0638692 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:56.758316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1caa0aa8-1fb5-494a-bf92-f5c8a0638692 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:56.769050 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1caa0aa8-1fb5-494a-bf92-f5c8a0638692 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:56.769616 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1caa0aa8-1fb5-494a-bf92-f5c8a0638692 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:56.770497 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1caa0aa8-1fb5-494a-bf92-f5c8a0638692 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:56.770981 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1caa0aa8-1fb5-494a-bf92-f5c8a0638692 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:56.939005 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1caa0aa8-1fb5-494a-bf92-f5c8a0638692 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:56.946863 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1caa0aa8-1fb5-494a-bf92-f5c8a0638692 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1368 microversion: 2.1 time: 0.194835 May 16 19:10:56.947766 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 206/423] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:56 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:57.085960 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-af2f5f86-5f6a-4265-8e25-99833038842f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:57.092039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-af2f5f86-5f6a-4265-8e25-99833038842f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:57.105145 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-af2f5f86-5f6a-4265-8e25-99833038842f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:57.106938 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-af2f5f86-5f6a-4265-8e25-99833038842f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:57.108033 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-af2f5f86-5f6a-4265-8e25-99833038842f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:57.110941 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-af2f5f86-5f6a-4265-8e25-99833038842f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:57.390827 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-af2f5f86-5f6a-4265-8e25-99833038842f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:57.409492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-af2f5f86-5f6a-4265-8e25-99833038842f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:57.409492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-af2f5f86-5f6a-4265-8e25-99833038842f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:57.409492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-af2f5f86-5f6a-4265-8e25-99833038842f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1740 microversion: 2.20 time: 0.333758 May 16 19:10:57.409889 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 207/424] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:57 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1740 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:57.663963 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-a575687c-8a55-452b-9927-6987967c9ce7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:57.665785 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-a575687c-8a55-452b-9927-6987967c9ce7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:57.690893 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a575687c-8a55-452b-9927-6987967c9ce7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:57.691799 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a575687c-8a55-452b-9927-6987967c9ce7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:57.692879 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a575687c-8a55-452b-9927-6987967c9ce7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:57.693511 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a575687c-8a55-452b-9927-6987967c9ce7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:57.851448 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-a575687c-8a55-452b-9927-6987967c9ce7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:57.863197 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-a575687c-8a55-452b-9927-6987967c9ce7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.203841 May 16 19:10:57.864206 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 208/425] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:57 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:57.965163 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f2847579-e346-4c37-b65a-5248a38856eb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:57.965923 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f2847579-e346-4c37-b65a-5248a38856eb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:57.976590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f2847579-e346-4c37-b65a-5248a38856eb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:57.977433 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f2847579-e346-4c37-b65a-5248a38856eb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:57.978487 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f2847579-e346-4c37-b65a-5248a38856eb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:57.978979 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f2847579-e346-4c37-b65a-5248a38856eb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:58.149368 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f2847579-e346-4c37-b65a-5248a38856eb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:58.157511 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f2847579-e346-4c37-b65a-5248a38856eb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1368 microversion: 2.1 time: 0.197029 May 16 19:10:58.158702 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 209/426] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:57 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:58.430731 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-2b13c741-f54e-4866-9ddd-c01cb03d0606 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:58.431278 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-2b13c741-f54e-4866-9ddd-c01cb03d0606 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:58.438082 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2b13c741-f54e-4866-9ddd-c01cb03d0606 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:58.438700 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2b13c741-f54e-4866-9ddd-c01cb03d0606 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:58.439485 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2b13c741-f54e-4866-9ddd-c01cb03d0606 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:58.439933 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2b13c741-f54e-4866-9ddd-c01cb03d0606 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:58.616315 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-2b13c741-f54e-4866-9ddd-c01cb03d0606 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:58.624958 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-2b13c741-f54e-4866-9ddd-c01cb03d0606 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:58.630267 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-2b13c741-f54e-4866-9ddd-c01cb03d0606 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:58.631464 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-2b13c741-f54e-4866-9ddd-c01cb03d0606 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1740 microversion: 2.20 time: 0.206895 May 16 19:10:58.641961 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 210/427] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:58 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:10:58.672204 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.network.neutron [None req-c7461366-de81-435b-a25d-73adb70bb04c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] validate_networks() for [('b0160fa7-2bfb-4bc1-8d58-6361ff669d8e', None, None, None, None, None)] {{(pid=117274) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:10:58.881255 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-387be5b6-0ec8-47dc-9644-11e22c8c750f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:58.882427 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-387be5b6-0ec8-47dc-9644-11e22c8c750f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:58.888751 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-387be5b6-0ec8-47dc-9644-11e22c8c750f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:58.889424 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-387be5b6-0ec8-47dc-9644-11e22c8c750f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:58.890227 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-387be5b6-0ec8-47dc-9644-11e22c8c750f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:58.890653 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-387be5b6-0ec8-47dc-9644-11e22c8c750f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:59.097932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-387be5b6-0ec8-47dc-9644-11e22c8c750f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:59.099762 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-c7461366-de81-435b-a25d-73adb70bb04c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Flavor limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:10:59.100264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-c7461366-de81-435b-a25d-73adb70bb04c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Image limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:10:59.100670 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-c7461366-de81-435b-a25d-73adb70bb04c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Flavor pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:10:59.101077 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-c7461366-de81-435b-a25d-73adb70bb04c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Image pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:10:59.101539 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-c7461366-de81-435b-a25d-73adb70bb04c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:10:59.110678 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-387be5b6-0ec8-47dc-9644-11e22c8c750f tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.233805 May 16 19:10:59.111622 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 211/428] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:58 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:10:59.112193 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c7461366-de81-435b-a25d-73adb70bb04c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:59.112655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c7461366-de81-435b-a25d-73adb70bb04c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:59.113506 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c7461366-de81-435b-a25d-73adb70bb04c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:59.113974 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c7461366-de81-435b-a25d-73adb70bb04c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:59.136568 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-c7461366-de81-435b-a25d-73adb70bb04c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Getting quotas for project ba2c6e5fee5b402fa68833228d12c8e7. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:10:59.140581 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-c7461366-de81-435b-a25d-73adb70bb04c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Getting quotas for user 1673e91c8910435499a5d587f4ef59f9 and project ba2c6e5fee5b402fa68833228d12c8e7. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:10:59.153975 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c7461366-de81-435b-a25d-73adb70bb04c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Going to run 1 instances... {{(pid=117274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:10:59.156692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c7461366-de81-435b-a25d-73adb70bb04c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:10:59.180496 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3f40589b-e8a9-440e-a01e-bf91487d1d7d tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:59.183611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-3f40589b-e8a9-440e-a01e-bf91487d1d7d tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:59.192168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3f40589b-e8a9-440e-a01e-bf91487d1d7d tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:59.193170 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3f40589b-e8a9-440e-a01e-bf91487d1d7d tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:59.194516 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3f40589b-e8a9-440e-a01e-bf91487d1d7d tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:59.195146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3f40589b-e8a9-440e-a01e-bf91487d1d7d tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:59.242839 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c7461366-de81-435b-a25d-73adb70bb04c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.001434 May 16 19:10:59.251151 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 218/429] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:10:56 2022] POST /compute/v2.1/servers => generated 408 bytes in 3011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:10:59.256369 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-93a589f5-4b63-4037-ba2f-100d6d72a29a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:59.264811 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-93a589f5-4b63-4037-ba2f-100d6d72a29a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:59.351316 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-93a589f5-4b63-4037-ba2f-100d6d72a29a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:59.359911 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-93a589f5-4b63-4037-ba2f-100d6d72a29a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1245 microversion: 2.1 time: 0.107324 May 16 19:10:59.360495 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 219/430] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:59 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:59.372852 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-90466fe2-15b5-4eda-a21e-49697970c375 req-bbde4132-9223-4b58-ab9f-54dcc83f8b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fbf87a-3557-408c-ac54-e6ca9017a0f1", "name": "network-vif-plugged", "status": "completed", "tag": "4c82ce8d-f16a-4001-99f0-aa83af3c4315"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:10:59.391896 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-90466fe2-15b5-4eda-a21e-49697970c375 req-bbde4132-9223-4b58-ab9f-54dcc83f8b26 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:59.393049 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-90466fe2-15b5-4eda-a21e-49697970c375 req-bbde4132-9223-4b58-ab9f-54dcc83f8b26 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:59.408146 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-90466fe2-15b5-4eda-a21e-49697970c375 req-bbde4132-9223-4b58-ab9f-54dcc83f8b26 service nova] Creating event network-vif-plugged:4c82ce8d-f16a-4001-99f0-aa83af3c4315 for instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 on hv-cinder-76606 May 16 19:10:59.417774 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-90466fe2-15b5-4eda-a21e-49697970c375 req-bbde4132-9223-4b58-ab9f-54dcc83f8b26 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053878 May 16 19:10:59.419024 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 220/431] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:10:59.542191 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-3f40589b-e8a9-440e-a01e-bf91487d1d7d tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:59.568548 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-3f40589b-e8a9-440e-a01e-bf91487d1d7d tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1368 microversion: 2.1 time: 0.393246 May 16 19:10:59.569594 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 212/432] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:10:59 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1368 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:10:59.652331 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f70e8c97-d8ba-4358-86d7-302bc7f89c8f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:10:59.653456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f70e8c97-d8ba-4358-86d7-302bc7f89c8f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:10:59.678279 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f70e8c97-d8ba-4358-86d7-302bc7f89c8f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:59.687249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f70e8c97-d8ba-4358-86d7-302bc7f89c8f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:59.689359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f70e8c97-d8ba-4358-86d7-302bc7f89c8f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:10:59.689994 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f70e8c97-d8ba-4358-86d7-302bc7f89c8f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:10:59.909884 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f70e8c97-d8ba-4358-86d7-302bc7f89c8f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:59.923125 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f70e8c97-d8ba-4358-86d7-302bc7f89c8f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:59.926420 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f70e8c97-d8ba-4358-86d7-302bc7f89c8f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:10:59.928216 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f70e8c97-d8ba-4358-86d7-302bc7f89c8f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1722 microversion: 2.20 time: 0.281568 May 16 19:10:59.929456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 221/433] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:10:59 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:00.127829 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d287c16f-1c68-47a6-a4b5-642e8495a3b0 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:00.128713 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d287c16f-1c68-47a6-a4b5-642e8495a3b0 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:00.135397 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d287c16f-1c68-47a6-a4b5-642e8495a3b0 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:00.135838 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d287c16f-1c68-47a6-a4b5-642e8495a3b0 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:00.136610 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d287c16f-1c68-47a6-a4b5-642e8495a3b0 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:00.137163 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d287c16f-1c68-47a6-a4b5-642e8495a3b0 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:00.274766 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d287c16f-1c68-47a6-a4b5-642e8495a3b0 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:00.283137 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d287c16f-1c68-47a6-a4b5-642e8495a3b0 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.159283 May 16 19:11:00.283789 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 213/434] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:00 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:00.377183 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-fa3dff1b-590e-4e1d-b7a1-d80183ed6cd6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:00.377853 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-fa3dff1b-590e-4e1d-b7a1-d80183ed6cd6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:00.384681 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fa3dff1b-590e-4e1d-b7a1-d80183ed6cd6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:00.385273 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fa3dff1b-590e-4e1d-b7a1-d80183ed6cd6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:00.386112 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fa3dff1b-590e-4e1d-b7a1-d80183ed6cd6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:00.386909 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fa3dff1b-590e-4e1d-b7a1-d80183ed6cd6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:00.461659 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-fa3dff1b-590e-4e1d-b7a1-d80183ed6cd6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:00.471605 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-fa3dff1b-590e-4e1d-b7a1-d80183ed6cd6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1241 microversion: 2.1 time: 0.098614 May 16 19:11:00.472563 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 222/435] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:00 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:00.590722 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0a16e969-d3a3-4528-b6ea-9d5bab190c19 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:00.591878 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0a16e969-d3a3-4528-b6ea-9d5bab190c19 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:00.600911 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0a16e969-d3a3-4528-b6ea-9d5bab190c19 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:00.601356 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0a16e969-d3a3-4528-b6ea-9d5bab190c19 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:00.602182 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0a16e969-d3a3-4528-b6ea-9d5bab190c19 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:00.602611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0a16e969-d3a3-4528-b6ea-9d5bab190c19 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:00.745426 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0a16e969-d3a3-4528-b6ea-9d5bab190c19 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:00.752998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0a16e969-d3a3-4528-b6ea-9d5bab190c19 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1368 microversion: 2.1 time: 0.166586 May 16 19:11:00.753587 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 214/436] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:00 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:00.948246 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0b8f44c8-afad-4c50-83f2-0d62443628c0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:00.948851 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0b8f44c8-afad-4c50-83f2-0d62443628c0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:00.965031 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0b8f44c8-afad-4c50-83f2-0d62443628c0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:00.965031 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0b8f44c8-afad-4c50-83f2-0d62443628c0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:00.965031 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0b8f44c8-afad-4c50-83f2-0d62443628c0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:00.965031 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0b8f44c8-afad-4c50-83f2-0d62443628c0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:01.099190 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0b8f44c8-afad-4c50-83f2-0d62443628c0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:01.107568 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0b8f44c8-afad-4c50-83f2-0d62443628c0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:01.109056 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0b8f44c8-afad-4c50-83f2-0d62443628c0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:01.110237 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0b8f44c8-afad-4c50-83f2-0d62443628c0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1722 microversion: 2.20 time: 0.165988 May 16 19:11:01.110848 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 223/437] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:00 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:01.301070 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c1738ece-edc0-4fa9-af64-2c6dc4276684 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:01.301731 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c1738ece-edc0-4fa9-af64-2c6dc4276684 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:01.308335 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c1738ece-edc0-4fa9-af64-2c6dc4276684 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:01.308815 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c1738ece-edc0-4fa9-af64-2c6dc4276684 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:01.309666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c1738ece-edc0-4fa9-af64-2c6dc4276684 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:01.310272 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c1738ece-edc0-4fa9-af64-2c6dc4276684 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:01.434438 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-6ff14819-c57c-4d1c-b6d4-bb47401ec0dc req-38ea1d99-1449-415a-b98f-6f0f93b7da85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eee5cef-ceca-43ee-8c12-060886550585", "name": "network-vif-plugged", "status": "completed", "tag": "64315f99-6584-4888-bfb0-c3b32c4b2501"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:01.443085 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-6ff14819-c57c-4d1c-b6d4-bb47401ec0dc req-38ea1d99-1449-415a-b98f-6f0f93b7da85 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:01.443630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-6ff14819-c57c-4d1c-b6d4-bb47401ec0dc req-38ea1d99-1449-415a-b98f-6f0f93b7da85 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:01.444163 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c1738ece-edc0-4fa9-af64-2c6dc4276684 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:01.452264 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c1738ece-edc0-4fa9-af64-2c6dc4276684 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.155172 May 16 19:11:01.458299 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-6ff14819-c57c-4d1c-b6d4-bb47401ec0dc req-38ea1d99-1449-415a-b98f-6f0f93b7da85 service nova] Creating event network-vif-plugged:64315f99-6584-4888-bfb0-c3b32c4b2501 for instance 6eee5cef-ceca-43ee-8c12-060886550585 on hv-cinder-76606 May 16 19:11:01.461601 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 215/438] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:01 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:01.464354 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-6ff14819-c57c-4d1c-b6d4-bb47401ec0dc req-38ea1d99-1449-415a-b98f-6f0f93b7da85 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033740 May 16 19:11:01.464932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 224/439] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:11:01.488477 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-72040dcd-e1b6-4c3e-898d-e33dd08129e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:01.489094 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-72040dcd-e1b6-4c3e-898d-e33dd08129e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:01.495441 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-72040dcd-e1b6-4c3e-898d-e33dd08129e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:01.495884 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-72040dcd-e1b6-4c3e-898d-e33dd08129e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:01.496650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-72040dcd-e1b6-4c3e-898d-e33dd08129e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:01.497094 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-72040dcd-e1b6-4c3e-898d-e33dd08129e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:01.557284 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-72040dcd-e1b6-4c3e-898d-e33dd08129e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:01.565456 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-72040dcd-e1b6-4c3e-898d-e33dd08129e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1297 microversion: 2.1 time: 0.080817 May 16 19:11:01.566092 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 216/440] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:01 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1297 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:01.770593 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-1569b24a-8a83-4992-9d85-1258e9ffd564 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:01.771282 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-1569b24a-8a83-4992-9d85-1258e9ffd564 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:01.778173 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1569b24a-8a83-4992-9d85-1258e9ffd564 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:01.778610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1569b24a-8a83-4992-9d85-1258e9ffd564 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:01.779373 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1569b24a-8a83-4992-9d85-1258e9ffd564 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:01.779813 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1569b24a-8a83-4992-9d85-1258e9ffd564 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:01.913178 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-1569b24a-8a83-4992-9d85-1258e9ffd564 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:01.922444 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-1569b24a-8a83-4992-9d85-1258e9ffd564 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1368 microversion: 2.1 time: 0.155977 May 16 19:11:01.923035 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 225/441] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:01 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:02.128691 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-6a99737d-6a01-4e4a-90cf-60656c9e50d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:02.129584 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-6a99737d-6a01-4e4a-90cf-60656c9e50d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:02.135802 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6a99737d-6a01-4e4a-90cf-60656c9e50d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:02.136446 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6a99737d-6a01-4e4a-90cf-60656c9e50d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:02.137396 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6a99737d-6a01-4e4a-90cf-60656c9e50d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:02.138036 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6a99737d-6a01-4e4a-90cf-60656c9e50d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:02.296293 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6a99737d-6a01-4e4a-90cf-60656c9e50d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:02.304168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6a99737d-6a01-4e4a-90cf-60656c9e50d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:02.305718 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6a99737d-6a01-4e4a-90cf-60656c9e50d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:02.306888 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-6a99737d-6a01-4e4a-90cf-60656c9e50d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1722 microversion: 2.20 time: 0.182216 May 16 19:11:02.309054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 217/442] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:02 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:02.468583 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a4060c87-7299-4ef0-b6df-fd4e5a35b166 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:02.469171 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a4060c87-7299-4ef0-b6df-fd4e5a35b166 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:02.476086 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a4060c87-7299-4ef0-b6df-fd4e5a35b166 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:02.476543 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a4060c87-7299-4ef0-b6df-fd4e5a35b166 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:02.477314 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a4060c87-7299-4ef0-b6df-fd4e5a35b166 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:02.477793 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a4060c87-7299-4ef0-b6df-fd4e5a35b166 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:02.582694 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b607c6c6-6921-41fe-ac27-b12267396909 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:02.583390 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b607c6c6-6921-41fe-ac27-b12267396909 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:02.590500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b607c6c6-6921-41fe-ac27-b12267396909 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:02.590939 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b607c6c6-6921-41fe-ac27-b12267396909 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:02.591719 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b607c6c6-6921-41fe-ac27-b12267396909 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:02.592157 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b607c6c6-6921-41fe-ac27-b12267396909 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:02.613739 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a4060c87-7299-4ef0-b6df-fd4e5a35b166 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:02.621568 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a4060c87-7299-4ef0-b6df-fd4e5a35b166 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.157034 May 16 19:11:02.622179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 226/443] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:02 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:02.659788 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b607c6c6-6921-41fe-ac27-b12267396909 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:02.667579 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b607c6c6-6921-41fe-ac27-b12267396909 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1297 microversion: 2.1 time: 0.088723 May 16 19:11:02.668148 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 218/444] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:02 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:02.940761 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-1b63aade-4d48-475f-8d0e-4aefb1f0c7d7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:02.941427 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-1b63aade-4d48-475f-8d0e-4aefb1f0c7d7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:02.948635 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1b63aade-4d48-475f-8d0e-4aefb1f0c7d7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:02.949108 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1b63aade-4d48-475f-8d0e-4aefb1f0c7d7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:02.949957 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1b63aade-4d48-475f-8d0e-4aefb1f0c7d7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:02.950484 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1b63aade-4d48-475f-8d0e-4aefb1f0c7d7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:03.083599 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-1b63aade-4d48-475f-8d0e-4aefb1f0c7d7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:03.092679 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-1b63aade-4d48-475f-8d0e-4aefb1f0c7d7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1368 microversion: 2.1 time: 0.156156 May 16 19:11:03.093207 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 227/445] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:02 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:03.326544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-41378ffa-af51-4c53-9ac5-d1b366dd35a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:03.327168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-41378ffa-af51-4c53-9ac5-d1b366dd35a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:03.333772 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-41378ffa-af51-4c53-9ac5-d1b366dd35a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:03.334172 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-41378ffa-af51-4c53-9ac5-d1b366dd35a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:03.334934 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-41378ffa-af51-4c53-9ac5-d1b366dd35a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:03.335370 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-41378ffa-af51-4c53-9ac5-d1b366dd35a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:03.471326 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-41378ffa-af51-4c53-9ac5-d1b366dd35a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:03.481152 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-41378ffa-af51-4c53-9ac5-d1b366dd35a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:03.481408 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-43ba4fec-e2ad-4a85-b3ab-f854a6376e88 req-7e1a4140-6932-48d9-9d45-d2a019842123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b53695-b6e7-4e7b-b6d5-539770d20f41", "name": "network-vif-unplugged", "status": "completed", "tag": "5ed69d31-3be1-4fa7-a495-fce15a7677cb"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:03.482711 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-41378ffa-af51-4c53-9ac5-d1b366dd35a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:03.483864 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-41378ffa-af51-4c53-9ac5-d1b366dd35a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1722 microversion: 2.20 time: 0.161449 May 16 19:11:03.484413 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 219/446] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:03 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:03.490063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-43ba4fec-e2ad-4a85-b3ab-f854a6376e88 req-7e1a4140-6932-48d9-9d45-d2a019842123 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:03.490497 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-43ba4fec-e2ad-4a85-b3ab-f854a6376e88 req-7e1a4140-6932-48d9-9d45-d2a019842123 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:03.502121 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-43ba4fec-e2ad-4a85-b3ab-f854a6376e88 req-7e1a4140-6932-48d9-9d45-d2a019842123 service nova] Creating event network-vif-unplugged:5ed69d31-3be1-4fa7-a495-fce15a7677cb for instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 on hv-cinder-76606 May 16 19:11:03.507303 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-43ba4fec-e2ad-4a85-b3ab-f854a6376e88 req-7e1a4140-6932-48d9-9d45-d2a019842123 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031081 May 16 19:11:03.507873 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 228/447] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:11:03.640501 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-a295946f-fd29-46de-a72b-698e2a29a1fc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:03.641121 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-a295946f-fd29-46de-a72b-698e2a29a1fc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:03.649905 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a295946f-fd29-46de-a72b-698e2a29a1fc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:03.650752 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a295946f-fd29-46de-a72b-698e2a29a1fc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:03.651749 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a295946f-fd29-46de-a72b-698e2a29a1fc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:03.652163 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a295946f-fd29-46de-a72b-698e2a29a1fc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:03.685379 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-21ea6664-e28b-4a78-832a-3c300194d0e9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:03.686126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-21ea6664-e28b-4a78-832a-3c300194d0e9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:03.693737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-21ea6664-e28b-4a78-832a-3c300194d0e9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:03.694897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-21ea6664-e28b-4a78-832a-3c300194d0e9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:03.696061 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-21ea6664-e28b-4a78-832a-3c300194d0e9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:03.696504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-21ea6664-e28b-4a78-832a-3c300194d0e9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:03.762502 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-21ea6664-e28b-4a78-832a-3c300194d0e9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:03.770399 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-21ea6664-e28b-4a78-832a-3c300194d0e9 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1297 microversion: 2.1 time: 0.089391 May 16 19:11:03.770980 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 229/448] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:03 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:03.791426 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-a295946f-fd29-46de-a72b-698e2a29a1fc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:03.798806 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-a295946f-fd29-46de-a72b-698e2a29a1fc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.162788 May 16 19:11:03.799378 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 220/449] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:03 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:04.109468 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d47b2c44-075a-4a43-ab11-5558602df366 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:04.110122 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d47b2c44-075a-4a43-ab11-5558602df366 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:04.116627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d47b2c44-075a-4a43-ab11-5558602df366 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:04.117110 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d47b2c44-075a-4a43-ab11-5558602df366 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:04.117910 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d47b2c44-075a-4a43-ab11-5558602df366 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:04.118341 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d47b2c44-075a-4a43-ab11-5558602df366 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:04.253710 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d47b2c44-075a-4a43-ab11-5558602df366 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:04.261584 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d47b2c44-075a-4a43-ab11-5558602df366 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1368 microversion: 2.1 time: 0.156012 May 16 19:11:04.262150 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 230/450] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:04 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:04.503256 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ac7fd51f-97f0-44c6-af8e-fceeb42022cf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:04.503932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ac7fd51f-97f0-44c6-af8e-fceeb42022cf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:04.511253 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ac7fd51f-97f0-44c6-af8e-fceeb42022cf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:04.511722 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ac7fd51f-97f0-44c6-af8e-fceeb42022cf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:04.512448 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ac7fd51f-97f0-44c6-af8e-fceeb42022cf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:04.512882 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ac7fd51f-97f0-44c6-af8e-fceeb42022cf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:04.647719 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ac7fd51f-97f0-44c6-af8e-fceeb42022cf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:04.656789 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ac7fd51f-97f0-44c6-af8e-fceeb42022cf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:04.658396 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ac7fd51f-97f0-44c6-af8e-fceeb42022cf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:04.659581 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ac7fd51f-97f0-44c6-af8e-fceeb42022cf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1722 microversion: 2.20 time: 0.160452 May 16 19:11:04.660103 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 221/451] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:04 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:04.788572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8a686700-a55c-4569-ac81-1239385565a8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:04.789164 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8a686700-a55c-4569-ac81-1239385565a8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:04.795759 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8a686700-a55c-4569-ac81-1239385565a8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:04.796235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8a686700-a55c-4569-ac81-1239385565a8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:04.796967 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8a686700-a55c-4569-ac81-1239385565a8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:04.797393 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8a686700-a55c-4569-ac81-1239385565a8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:04.815686 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1fd93df7-b873-4eab-900b-7a553e056655 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:04.816402 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1fd93df7-b873-4eab-900b-7a553e056655 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:04.826161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1fd93df7-b873-4eab-900b-7a553e056655 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:04.826802 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1fd93df7-b873-4eab-900b-7a553e056655 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:04.827633 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1fd93df7-b873-4eab-900b-7a553e056655 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:04.828130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1fd93df7-b873-4eab-900b-7a553e056655 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:04.860836 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-8a686700-a55c-4569-ac81-1239385565a8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:04.868848 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8a686700-a55c-4569-ac81-1239385565a8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1297 microversion: 2.1 time: 0.084285 May 16 19:11:04.869424 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 231/452] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:04 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:04.961463 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1fd93df7-b873-4eab-900b-7a553e056655 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:04.970262 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1fd93df7-b873-4eab-900b-7a553e056655 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.159017 May 16 19:11:04.970817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 222/453] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:04 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:05.279362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-840eeaf1-78d8-4138-a195-13e800962283 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:05.280102 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-840eeaf1-78d8-4138-a195-13e800962283 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:05.286864 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-840eeaf1-78d8-4138-a195-13e800962283 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:05.287327 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-840eeaf1-78d8-4138-a195-13e800962283 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:05.288120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-840eeaf1-78d8-4138-a195-13e800962283 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:05.288827 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-840eeaf1-78d8-4138-a195-13e800962283 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:05.427279 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-840eeaf1-78d8-4138-a195-13e800962283 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:05.434785 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-840eeaf1-78d8-4138-a195-13e800962283 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1368 microversion: 2.1 time: 0.159725 May 16 19:11:05.435357 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 232/454] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:05 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:05.682689 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-6f23fc91-dce1-49f4-8eed-a624057e1a4b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:05.683717 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-6f23fc91-dce1-49f4-8eed-a624057e1a4b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:05.694819 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6f23fc91-dce1-49f4-8eed-a624057e1a4b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:05.695574 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6f23fc91-dce1-49f4-8eed-a624057e1a4b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:05.696851 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6f23fc91-dce1-49f4-8eed-a624057e1a4b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:05.697606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6f23fc91-dce1-49f4-8eed-a624057e1a4b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:05.840818 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6f23fc91-dce1-49f4-8eed-a624057e1a4b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:05.848816 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6f23fc91-dce1-49f4-8eed-a624057e1a4b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:05.850400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6f23fc91-dce1-49f4-8eed-a624057e1a4b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:05.851546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-6f23fc91-dce1-49f4-8eed-a624057e1a4b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1722 microversion: 2.20 time: 0.176198 May 16 19:11:05.852108 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 223/455] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:05 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:05.885990 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8b0160e4-07c0-4183-8acd-7cf31702cb99 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:05.886623 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8b0160e4-07c0-4183-8acd-7cf31702cb99 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:05.893286 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8b0160e4-07c0-4183-8acd-7cf31702cb99 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:05.893770 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8b0160e4-07c0-4183-8acd-7cf31702cb99 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:05.894549 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8b0160e4-07c0-4183-8acd-7cf31702cb99 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:05.894972 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8b0160e4-07c0-4183-8acd-7cf31702cb99 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:05.988276 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-2244a6f6-1ea0-408a-ade5-903c30b0af9d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:05.989395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-2244a6f6-1ea0-408a-ade5-903c30b0af9d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:06.009210 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2244a6f6-1ea0-408a-ade5-903c30b0af9d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:06.010562 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2244a6f6-1ea0-408a-ade5-903c30b0af9d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:06.011453 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2244a6f6-1ea0-408a-ade5-903c30b0af9d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:06.011964 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2244a6f6-1ea0-408a-ade5-903c30b0af9d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:06.232803 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-8b0160e4-07c0-4183-8acd-7cf31702cb99 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:06.246940 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8b0160e4-07c0-4183-8acd-7cf31702cb99 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1297 microversion: 2.1 time: 0.364876 May 16 19:11:06.247788 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 233/456] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:05 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1297 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:06.276823 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-2244a6f6-1ea0-408a-ade5-903c30b0af9d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:06.284521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-2244a6f6-1ea0-408a-ade5-903c30b0af9d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.301321 May 16 19:11:06.285094 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 224/457] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:05 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:11:06.452445 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-845b40c2-c0df-402a-92bc-0cdd24b69650 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:06.453060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-845b40c2-c0df-402a-92bc-0cdd24b69650 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:06.467245 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-845b40c2-c0df-402a-92bc-0cdd24b69650 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:06.467802 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-845b40c2-c0df-402a-92bc-0cdd24b69650 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:06.468724 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-845b40c2-c0df-402a-92bc-0cdd24b69650 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:06.469624 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-845b40c2-c0df-402a-92bc-0cdd24b69650 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:06.614207 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-845b40c2-c0df-402a-92bc-0cdd24b69650 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:06.622163 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-845b40c2-c0df-402a-92bc-0cdd24b69650 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1558 microversion: 2.1 time: 0.174241 May 16 19:11:06.622762 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 234/458] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:06 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:06.639184 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-6373100a-db7e-4a10-a41d-6baeaed70d4e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:06.639642 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-6373100a-db7e-4a10-a41d-6baeaed70d4e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:06.648304 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6373100a-db7e-4a10-a41d-6baeaed70d4e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:06.648754 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6373100a-db7e-4a10-a41d-6baeaed70d4e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:06.649560 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6373100a-db7e-4a10-a41d-6baeaed70d4e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:06.650363 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6373100a-db7e-4a10-a41d-6baeaed70d4e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:06.738283 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-6373100a-db7e-4a10-a41d-6baeaed70d4e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102709 May 16 19:11:06.739225 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 225/459] 10.222.0.24 () {58 vars in 1274 bytes} [Mon May 16 19:11:06 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:11:06.870057 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c68663d4-775f-4451-b86e-43e67a75cbcb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:06.870781 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c68663d4-775f-4451-b86e-43e67a75cbcb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:06.877088 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c68663d4-775f-4451-b86e-43e67a75cbcb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:06.877559 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c68663d4-775f-4451-b86e-43e67a75cbcb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:06.878356 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c68663d4-775f-4451-b86e-43e67a75cbcb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:06.878793 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c68663d4-775f-4451-b86e-43e67a75cbcb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:07.143134 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c68663d4-775f-4451-b86e-43e67a75cbcb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:07.151722 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c68663d4-775f-4451-b86e-43e67a75cbcb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:07.153327 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c68663d4-775f-4451-b86e-43e67a75cbcb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:07.154532 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c68663d4-775f-4451-b86e-43e67a75cbcb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1725 microversion: 2.20 time: 0.288511 May 16 19:11:07.155068 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 235/460] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:06 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:07.173974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-a7b1abb4-9885-4a86-b352-87a38ee2a257 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae7a181b-587c-4398-92d1-0f8b3cd8b7df"}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:07.175406 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-a7b1abb4-9885-4a86-b352-87a38ee2a257 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:07.182048 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a7b1abb4-9885-4a86-b352-87a38ee2a257 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:07.183137 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a7b1abb4-9885-4a86-b352-87a38ee2a257 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:07.183927 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a7b1abb4-9885-4a86-b352-87a38ee2a257 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:07.184369 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a7b1abb4-9885-4a86-b352-87a38ee2a257 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:07.264091 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4ae00f33-37cd-467e-a9f8-6bec30923f69 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:07.264692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-4ae00f33-37cd-467e-a9f8-6bec30923f69 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:07.271359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4ae00f33-37cd-467e-a9f8-6bec30923f69 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:07.271810 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4ae00f33-37cd-467e-a9f8-6bec30923f69 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:07.272631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4ae00f33-37cd-467e-a9f8-6bec30923f69 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:07.273063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4ae00f33-37cd-467e-a9f8-6bec30923f69 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:07.376956 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4ae00f33-37cd-467e-a9f8-6bec30923f69 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:07.385692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4ae00f33-37cd-467e-a9f8-6bec30923f69 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1297 microversion: 2.1 time: 0.125871 May 16 19:11:07.386845 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 236/461] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:07 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1297 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:07.391829 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-518d37a8-a172-4fab-ba18-1a5098abae47 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:07.392765 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-518d37a8-a172-4fab-ba18-1a5098abae47 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:07.399353 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-518d37a8-a172-4fab-ba18-1a5098abae47 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:07.400306 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-518d37a8-a172-4fab-ba18-1a5098abae47 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:07.401110 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-518d37a8-a172-4fab-ba18-1a5098abae47 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:07.401524 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-518d37a8-a172-4fab-ba18-1a5098abae47 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:07.512205 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-a7b1abb4-9885-4a86-b352-87a38ee2a257 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "POST /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.341639 May 16 19:11:07.512205 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 226/462] 10.222.0.24 () {62 vars in 1363 bytes} [Mon May 16 19:11:07 2022] POST /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-volume_attachments => generated 188 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:11:07.619312 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-518d37a8-a172-4fab-ba18-1a5098abae47 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:07.627103 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-df284248-359f-4923-9c53-49dbc12dd4f9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:07.627850 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-df284248-359f-4923-9c53-49dbc12dd4f9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:07.627961 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-518d37a8-a172-4fab-ba18-1a5098abae47 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.239758 May 16 19:11:07.633500 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 237/463] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:07 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:07.635134 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-df284248-359f-4923-9c53-49dbc12dd4f9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:07.635860 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-df284248-359f-4923-9c53-49dbc12dd4f9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:07.637379 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-df284248-359f-4923-9c53-49dbc12dd4f9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:07.637920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-df284248-359f-4923-9c53-49dbc12dd4f9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:07.736517 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-df284248-359f-4923-9c53-49dbc12dd4f9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "POST /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/action" status: 202 len: 0 microversion: 2.20 time: 0.114063 May 16 19:11:07.737351 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 227/464] 10.222.0.24 () {62 vars in 1318 bytes} [Mon May 16 19:11:07 2022] POST /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 19:11:07.745392 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4c4d147b-8004-47e9-ae73-24f2fc520572 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:07.746208 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-4c4d147b-8004-47e9-ae73-24f2fc520572 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:07.755093 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4c4d147b-8004-47e9-ae73-24f2fc520572 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:07.755093 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4c4d147b-8004-47e9-ae73-24f2fc520572 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:07.755093 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4c4d147b-8004-47e9-ae73-24f2fc520572 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:07.755093 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4c4d147b-8004-47e9-ae73-24f2fc520572 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:07.944559 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-2bc77ee6-464b-4c17-abe9-61820d531aea req-1f172850-5668-4641-9c22-77a863265d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73fbf87a-3557-408c-ac54-e6ca9017a0f1", "tag": "4c82ce8d-f16a-4001-99f0-aa83af3c4315"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:07.955632 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-2bc77ee6-464b-4c17-abe9-61820d531aea req-1f172850-5668-4641-9c22-77a863265d05 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:07.956321 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-2bc77ee6-464b-4c17-abe9-61820d531aea req-1f172850-5668-4641-9c22-77a863265d05 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:07.968012 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-2bc77ee6-464b-4c17-abe9-61820d531aea req-1f172850-5668-4641-9c22-77a863265d05 service nova] Creating event network-changed:4c82ce8d-f16a-4001-99f0-aa83af3c4315 for instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 on hv-cinder-76606 May 16 19:11:07.972276 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4c4d147b-8004-47e9-ae73-24f2fc520572 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:07.974156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-2bc77ee6-464b-4c17-abe9-61820d531aea req-1f172850-5668-4641-9c22-77a863265d05 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033355 May 16 19:11:07.975265 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 228/465] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:11:07.985024 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4c4d147b-8004-47e9-ae73-24f2fc520572 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:07.986887 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4c4d147b-8004-47e9-ae73-24f2fc520572 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:07.988147 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4c4d147b-8004-47e9-ae73-24f2fc520572 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1811 microversion: 2.20 time: 0.246825 May 16 19:11:07.988710 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 238/466] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:07 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1811 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:11:08.403335 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4d15d0f2-c215-45d5-af2d-67f9528e652f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:08.404034 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-4d15d0f2-c215-45d5-af2d-67f9528e652f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:08.410460 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4d15d0f2-c215-45d5-af2d-67f9528e652f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:08.410901 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4d15d0f2-c215-45d5-af2d-67f9528e652f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:08.411678 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4d15d0f2-c215-45d5-af2d-67f9528e652f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:08.412110 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4d15d0f2-c215-45d5-af2d-67f9528e652f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:08.477017 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4d15d0f2-c215-45d5-af2d-67f9528e652f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:08.485385 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4d15d0f2-c215-45d5-af2d-67f9528e652f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1297 microversion: 2.1 time: 0.086553 May 16 19:11:08.486214 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 229/467] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:08 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:08.644415 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0585b036-fac0-47aa-b48f-53a47eb8a598 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:08.645041 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0585b036-fac0-47aa-b48f-53a47eb8a598 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:08.651916 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0585b036-fac0-47aa-b48f-53a47eb8a598 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:08.652479 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0585b036-fac0-47aa-b48f-53a47eb8a598 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:08.653358 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0585b036-fac0-47aa-b48f-53a47eb8a598 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:08.654055 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0585b036-fac0-47aa-b48f-53a47eb8a598 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:08.805451 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0585b036-fac0-47aa-b48f-53a47eb8a598 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:08.814081 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0585b036-fac0-47aa-b48f-53a47eb8a598 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.173508 May 16 19:11:08.814908 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 239/468] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:08 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:09.006537 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8de5b1c1-1080-483c-99fb-7f00a396f244 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:09.007148 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8de5b1c1-1080-483c-99fb-7f00a396f244 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:09.014144 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8de5b1c1-1080-483c-99fb-7f00a396f244 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:09.014886 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8de5b1c1-1080-483c-99fb-7f00a396f244 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:09.015815 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8de5b1c1-1080-483c-99fb-7f00a396f244 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:09.016372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8de5b1c1-1080-483c-99fb-7f00a396f244 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:09.150955 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8de5b1c1-1080-483c-99fb-7f00a396f244 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:09.160116 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8de5b1c1-1080-483c-99fb-7f00a396f244 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:09.161586 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8de5b1c1-1080-483c-99fb-7f00a396f244 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:09.162775 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8de5b1c1-1080-483c-99fb-7f00a396f244 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1811 microversion: 2.20 time: 0.160306 May 16 19:11:09.163314 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 230/469] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:09 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:09.504972 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-515906e3-3d10-451c-b271-7d743821499a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:09.506029 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-515906e3-3d10-451c-b271-7d743821499a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:09.516941 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-515906e3-3d10-451c-b271-7d743821499a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:09.517738 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-515906e3-3d10-451c-b271-7d743821499a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:09.519010 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-515906e3-3d10-451c-b271-7d743821499a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:09.519743 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-515906e3-3d10-451c-b271-7d743821499a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:09.588933 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-515906e3-3d10-451c-b271-7d743821499a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:09.596610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-515906e3-3d10-451c-b271-7d743821499a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1297 microversion: 2.1 time: 0.097837 May 16 19:11:09.597181 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 240/470] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:09 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:09.834712 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8991d231-73fd-4c7c-9311-1c02c70e72d6 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:09.835332 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8991d231-73fd-4c7c-9311-1c02c70e72d6 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:09.844990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8991d231-73fd-4c7c-9311-1c02c70e72d6 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:09.845443 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8991d231-73fd-4c7c-9311-1c02c70e72d6 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:09.846541 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8991d231-73fd-4c7c-9311-1c02c70e72d6 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:09.846980 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8991d231-73fd-4c7c-9311-1c02c70e72d6 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:10.182173 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0610ef13-a21f-4319-9aaa-537f45a5c3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:10.182776 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0610ef13-a21f-4319-9aaa-537f45a5c3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:10.189273 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0610ef13-a21f-4319-9aaa-537f45a5c3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:10.189761 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0610ef13-a21f-4319-9aaa-537f45a5c3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:10.190549 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0610ef13-a21f-4319-9aaa-537f45a5c3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:10.190984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0610ef13-a21f-4319-9aaa-537f45a5c3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:10.394175 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0610ef13-a21f-4319-9aaa-537f45a5c3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:10.403872 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0610ef13-a21f-4319-9aaa-537f45a5c3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:10.424818 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0610ef13-a21f-4319-9aaa-537f45a5c3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:10.426075 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0610ef13-a21f-4319-9aaa-537f45a5c3ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1811 microversion: 2.20 time: 0.247981 May 16 19:11:10.442021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 241/471] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:10 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1811 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:11:10.553580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c9f52222-5ace-4526-97a8-51adbb779226 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:10.554190 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c9f52222-5ace-4526-97a8-51adbb779226 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:10.560924 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c9f52222-5ace-4526-97a8-51adbb779226 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:10.562240 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c9f52222-5ace-4526-97a8-51adbb779226 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:10.563167 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c9f52222-5ace-4526-97a8-51adbb779226 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:10.563844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c9f52222-5ace-4526-97a8-51adbb779226 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:10.572287 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8991d231-73fd-4c7c-9311-1c02c70e72d6 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:10.580038 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8991d231-73fd-4c7c-9311-1c02c70e72d6 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.752592 May 16 19:11:10.580841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 231/472] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:09 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:10.614790 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-2dee6535-83ab-4854-afea-2aa44d130f06 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:10.615356 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-2dee6535-83ab-4854-afea-2aa44d130f06 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:10.623145 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2dee6535-83ab-4854-afea-2aa44d130f06 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:10.623870 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2dee6535-83ab-4854-afea-2aa44d130f06 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:10.624882 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2dee6535-83ab-4854-afea-2aa44d130f06 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:10.625591 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2dee6535-83ab-4854-afea-2aa44d130f06 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:10.709045 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-2dee6535-83ab-4854-afea-2aa44d130f06 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:10.717986 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-2dee6535-83ab-4854-afea-2aa44d130f06 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1305 microversion: 2.1 time: 0.107920 May 16 19:11:10.718934 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 232/473] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:10 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:10.722139 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c9f52222-5ace-4526-97a8-51adbb779226 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:10.730769 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c9f52222-5ace-4526-97a8-51adbb779226 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1594 microversion: 2.1 time: 0.180938 May 16 19:11:10.732188 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 242/474] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:10 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1594 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:11:11.445166 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-6c82e1d8-484f-40fd-aeb2-b08060f7c550 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:11.445721 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-6c82e1d8-484f-40fd-aeb2-b08060f7c550 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:11.452468 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6c82e1d8-484f-40fd-aeb2-b08060f7c550 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:11.452937 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6c82e1d8-484f-40fd-aeb2-b08060f7c550 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:11.453738 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6c82e1d8-484f-40fd-aeb2-b08060f7c550 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:11.454167 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6c82e1d8-484f-40fd-aeb2-b08060f7c550 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:11.582030 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6c82e1d8-484f-40fd-aeb2-b08060f7c550 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:11.590552 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6c82e1d8-484f-40fd-aeb2-b08060f7c550 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:11.592168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6c82e1d8-484f-40fd-aeb2-b08060f7c550 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:11.593595 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-6c82e1d8-484f-40fd-aeb2-b08060f7c550 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1753 microversion: 2.20 time: 0.153038 May 16 19:11:11.594161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 233/475] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:11 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:11.596292 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-def00f6f-2064-4f95-aa7c-97e617170812 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:11.597427 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-def00f6f-2064-4f95-aa7c-97e617170812 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:11.603823 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-def00f6f-2064-4f95-aa7c-97e617170812 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:11.604272 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-def00f6f-2064-4f95-aa7c-97e617170812 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:11.605038 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-def00f6f-2064-4f95-aa7c-97e617170812 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:11.605474 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-def00f6f-2064-4f95-aa7c-97e617170812 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:11.736377 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5a89f250-0ed9-4d1d-bdcb-514d2a5dfcab tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:11.737264 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5a89f250-0ed9-4d1d-bdcb-514d2a5dfcab tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:11.745179 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5a89f250-0ed9-4d1d-bdcb-514d2a5dfcab tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:11.745655 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5a89f250-0ed9-4d1d-bdcb-514d2a5dfcab tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:11.746502 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5a89f250-0ed9-4d1d-bdcb-514d2a5dfcab tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:11.746991 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5a89f250-0ed9-4d1d-bdcb-514d2a5dfcab tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:11.802802 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-def00f6f-2064-4f95-aa7c-97e617170812 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:11.810534 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-def00f6f-2064-4f95-aa7c-97e617170812 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.218074 May 16 19:11:11.812522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5a89f250-0ed9-4d1d-bdcb-514d2a5dfcab tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:11.820415 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 243/476] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:11 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:11.822151 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5a89f250-0ed9-4d1d-bdcb-514d2a5dfcab tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1303 microversion: 2.1 time: 0.089198 May 16 19:11:11.827125 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 234/477] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:11 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:12.612633 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-21c49538-f08d-4342-b5b8-47e4b5c4baf6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:12.613284 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-21c49538-f08d-4342-b5b8-47e4b5c4baf6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:12.620042 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-21c49538-f08d-4342-b5b8-47e4b5c4baf6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:12.620508 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-21c49538-f08d-4342-b5b8-47e4b5c4baf6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:12.621266 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-21c49538-f08d-4342-b5b8-47e4b5c4baf6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:12.621738 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-21c49538-f08d-4342-b5b8-47e4b5c4baf6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:12.820370 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-3e0aac54-77d7-4065-a29d-30d1003d2821 req-5d9bdb9c-b69b-4ba4-a02a-b876cae8edbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e0298bd-7166-4b67-acf1-794621e95cdf", "tag": "12358361-c4bc-4509-98f8-117b7fd4543e"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:12.829302 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-3e0aac54-77d7-4065-a29d-30d1003d2821 req-5d9bdb9c-b69b-4ba4-a02a-b876cae8edbe service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:12.829302 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-3e0aac54-77d7-4065-a29d-30d1003d2821 req-5d9bdb9c-b69b-4ba4-a02a-b876cae8edbe service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:12.829715 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-21c49538-f08d-4342-b5b8-47e4b5c4baf6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:12.839294 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-21c49538-f08d-4342-b5b8-47e4b5c4baf6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:12.840443 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-3e0aac54-77d7-4065-a29d-30d1003d2821 req-5d9bdb9c-b69b-4ba4-a02a-b876cae8edbe service nova] Creating event network-changed:12358361-c4bc-4509-98f8-117b7fd4543e for instance 1e0298bd-7166-4b67-acf1-794621e95cdf on hv-cinder-76606 May 16 19:11:12.842300 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-21c49538-f08d-4342-b5b8-47e4b5c4baf6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:12.844133 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-21c49538-f08d-4342-b5b8-47e4b5c4baf6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1753 microversion: 2.20 time: 0.235534 May 16 19:11:12.845929 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 244/478] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:12 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1753 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:12.846254 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-3e0aac54-77d7-4065-a29d-30d1003d2821 req-5d9bdb9c-b69b-4ba4-a02a-b876cae8edbe service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029730 May 16 19:11:12.847425 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 235/479] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:11:12.853820 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0f62841d-edba-4941-9282-d26a29b95780 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:12.854755 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0f62841d-edba-4941-9282-d26a29b95780 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:12.860156 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-20d95c8f-6dde-40e3-a460-d76eac1d96f1 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:12.861779 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-20d95c8f-6dde-40e3-a460-d76eac1d96f1 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:12.868664 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-20d95c8f-6dde-40e3-a460-d76eac1d96f1 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:12.869344 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-20d95c8f-6dde-40e3-a460-d76eac1d96f1 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:12.870389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-20d95c8f-6dde-40e3-a460-d76eac1d96f1 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:12.871138 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-20d95c8f-6dde-40e3-a460-d76eac1d96f1 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:12.879441 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0f62841d-edba-4941-9282-d26a29b95780 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:12.879909 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0f62841d-edba-4941-9282-d26a29b95780 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:12.880714 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0f62841d-edba-4941-9282-d26a29b95780 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:12.881133 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0f62841d-edba-4941-9282-d26a29b95780 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:12.978365 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0f62841d-edba-4941-9282-d26a29b95780 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:12.988255 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0f62841d-edba-4941-9282-d26a29b95780 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1303 microversion: 2.1 time: 0.139163 May 16 19:11:12.989404 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 236/480] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:12 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1303 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:13.035041 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-20d95c8f-6dde-40e3-a460-d76eac1d96f1 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:13.043115 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-20d95c8f-6dde-40e3-a460-d76eac1d96f1 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.186508 May 16 19:11:13.043250 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 245/481] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:12 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:13.810671 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-a3297b68-0d54-41ed-9ce5-6f88f84e4186 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-153102917"}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:13.811202 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-a3297b68-0d54-41ed-9ce5-6f88f84e4186 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:13.817570 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a3297b68-0d54-41ed-9ce5-6f88f84e4186 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:13.818025 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a3297b68-0d54-41ed-9ce5-6f88f84e4186 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:13.818817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a3297b68-0d54-41ed-9ce5-6f88f84e4186 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:13.819286 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a3297b68-0d54-41ed-9ce5-6f88f84e4186 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:13.862939 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c3993a29-42b6-4b68-a923-d57d48bd20fb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:13.863554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c3993a29-42b6-4b68-a923-d57d48bd20fb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:13.870194 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c3993a29-42b6-4b68-a923-d57d48bd20fb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:13.870645 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c3993a29-42b6-4b68-a923-d57d48bd20fb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:13.871431 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c3993a29-42b6-4b68-a923-d57d48bd20fb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:13.871864 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c3993a29-42b6-4b68-a923-d57d48bd20fb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:13.954559 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.network.security_group_api [None req-a3297b68-0d54-41ed-9ce5-6f88f84e4186 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Adding security group 7a7af06b-3403-412f-9e75-8297761b6afd to port 12358361-c4bc-4509-98f8-117b7fd4543e May 16 19:11:14.017037 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c3993a29-42b6-4b68-a923-d57d48bd20fb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:14.027745 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c3993a29-42b6-4b68-a923-d57d48bd20fb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:14.029459 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c3993a29-42b6-4b68-a923-d57d48bd20fb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:14.030810 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c3993a29-42b6-4b68-a923-d57d48bd20fb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1753 microversion: 2.20 time: 0.171970 May 16 19:11:14.031373 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 246/482] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:13 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:11:14.037509 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c8a41736-1759-4e0a-8470-f4bff66e891d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:14.037509 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c8a41736-1759-4e0a-8470-f4bff66e891d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:14.043597 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c8a41736-1759-4e0a-8470-f4bff66e891d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:14.044037 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c8a41736-1759-4e0a-8470-f4bff66e891d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:14.044800 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c8a41736-1759-4e0a-8470-f4bff66e891d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:14.045229 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c8a41736-1759-4e0a-8470-f4bff66e891d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:14.105872 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c8a41736-1759-4e0a-8470-f4bff66e891d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:14.113346 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c8a41736-1759-4e0a-8470-f4bff66e891d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1303 microversion: 2.1 time: 0.080738 May 16 19:11:14.113950 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 247/483] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:14 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1303 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:14.118609 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-adc79fb5-d8a3-4190-a7fe-ed0cf931b6b5 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:14.119236 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-adc79fb5-d8a3-4190-a7fe-ed0cf931b6b5 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:14.125220 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-adc79fb5-d8a3-4190-a7fe-ed0cf931b6b5 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:14.125746 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-adc79fb5-d8a3-4190-a7fe-ed0cf931b6b5 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:14.126531 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-adc79fb5-d8a3-4190-a7fe-ed0cf931b6b5 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:14.126965 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-adc79fb5-d8a3-4190-a7fe-ed0cf931b6b5 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:14.260147 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-adc79fb5-d8a3-4190-a7fe-ed0cf931b6b5 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:14.267574 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-adc79fb5-d8a3-4190-a7fe-ed0cf931b6b5 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.152494 May 16 19:11:14.268143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 248/484] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:14 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:14.354304 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-a3297b68-0d54-41ed-9ce5-6f88f84e4186 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "POST /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/action" status: 202 len: 0 microversion: 2.1 time: 0.547481 May 16 19:11:14.355852 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 237/485] 10.222.0.24 () {60 vars in 1277 bytes} [Mon May 16 19:11:13 2022] POST /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:11:14.363733 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-cc5ed6d9-35f5-42a7-86f9-e65080e16d46 req-f1c018bd-2780-43df-af9c-f5cabca560fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e0298bd-7166-4b67-acf1-794621e95cdf", "tag": "12358361-c4bc-4509-98f8-117b7fd4543e"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:14.364016 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3880b203-0b47-423e-a4b2-bf76c977fbe4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:14.364654 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-3880b203-0b47-423e-a4b2-bf76c977fbe4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:14.371216 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3880b203-0b47-423e-a4b2-bf76c977fbe4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:14.372070 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3880b203-0b47-423e-a4b2-bf76c977fbe4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:14.373145 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3880b203-0b47-423e-a4b2-bf76c977fbe4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:14.373264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-cc5ed6d9-35f5-42a7-86f9-e65080e16d46 req-f1c018bd-2780-43df-af9c-f5cabca560fd service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:14.373821 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-cc5ed6d9-35f5-42a7-86f9-e65080e16d46 req-f1c018bd-2780-43df-af9c-f5cabca560fd service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:14.373955 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3880b203-0b47-423e-a4b2-bf76c977fbe4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:14.396305 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-cc5ed6d9-35f5-42a7-86f9-e65080e16d46 req-f1c018bd-2780-43df-af9c-f5cabca560fd service nova] Creating event network-changed:12358361-c4bc-4509-98f8-117b7fd4543e for instance 1e0298bd-7166-4b67-acf1-794621e95cdf on hv-cinder-76606 May 16 19:11:14.402016 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-cc5ed6d9-35f5-42a7-86f9-e65080e16d46 req-f1c018bd-2780-43df-af9c-f5cabca560fd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041959 May 16 19:11:14.403093 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 249/486] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:11:14.535024 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-3880b203-0b47-423e-a4b2-bf76c977fbe4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:14.543338 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-3880b203-0b47-423e-a4b2-bf76c977fbe4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1640 microversion: 2.1 time: 0.183464 May 16 19:11:14.544749 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 238/487] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:14 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1640 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:15.054254 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e77f4765-c770-481d-8acc-0a14f57a46e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:15.054801 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e77f4765-c770-481d-8acc-0a14f57a46e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:15.061898 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e77f4765-c770-481d-8acc-0a14f57a46e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:15.062715 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e77f4765-c770-481d-8acc-0a14f57a46e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:15.063685 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e77f4765-c770-481d-8acc-0a14f57a46e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:15.064111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e77f4765-c770-481d-8acc-0a14f57a46e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:15.130424 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-77b166a7-aba0-4abd-a8f4-adfc2ee4bca3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:15.131594 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-77b166a7-aba0-4abd-a8f4-adfc2ee4bca3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:15.139484 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-77b166a7-aba0-4abd-a8f4-adfc2ee4bca3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:15.139948 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-77b166a7-aba0-4abd-a8f4-adfc2ee4bca3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:15.140734 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-77b166a7-aba0-4abd-a8f4-adfc2ee4bca3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:15.141257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-77b166a7-aba0-4abd-a8f4-adfc2ee4bca3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:15.224820 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-77b166a7-aba0-4abd-a8f4-adfc2ee4bca3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:15.235154 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-77b166a7-aba0-4abd-a8f4-adfc2ee4bca3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1303 microversion: 2.1 time: 0.107713 May 16 19:11:15.236436 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 239/488] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:15 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:15.247086 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e77f4765-c770-481d-8acc-0a14f57a46e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:15.257189 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e77f4765-c770-481d-8acc-0a14f57a46e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:15.258924 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e77f4765-c770-481d-8acc-0a14f57a46e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:15.260305 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e77f4765-c770-481d-8acc-0a14f57a46e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1753 microversion: 2.20 time: 0.214389 May 16 19:11:15.260939 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 250/489] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:15 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1753 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:15.284419 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-6c61918a-2c34-42ca-8cea-cf24f9854bdb tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:15.285038 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-6c61918a-2c34-42ca-8cea-cf24f9854bdb tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:15.291221 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6c61918a-2c34-42ca-8cea-cf24f9854bdb tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:15.291673 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6c61918a-2c34-42ca-8cea-cf24f9854bdb tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:15.292441 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6c61918a-2c34-42ca-8cea-cf24f9854bdb tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:15.292874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6c61918a-2c34-42ca-8cea-cf24f9854bdb tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:15.712228 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6c61918a-2c34-42ca-8cea-cf24f9854bdb tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:15.723055 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-6c61918a-2c34-42ca-8cea-cf24f9854bdb tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.442452 May 16 19:11:15.723986 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 240/490] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:15 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:16.252945 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-1f72eba9-f9db-4f77-9ce2-feb65d77f766 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:16.254357 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-1f72eba9-f9db-4f77-9ce2-feb65d77f766 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:16.263388 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1f72eba9-f9db-4f77-9ce2-feb65d77f766 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:16.263810 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1f72eba9-f9db-4f77-9ce2-feb65d77f766 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:16.264768 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1f72eba9-f9db-4f77-9ce2-feb65d77f766 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:16.265381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1f72eba9-f9db-4f77-9ce2-feb65d77f766 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:16.281298 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ea95c503-03e5-4ca3-a68b-16c2cd70a81c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:16.283768 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ea95c503-03e5-4ca3-a68b-16c2cd70a81c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:16.293240 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ea95c503-03e5-4ca3-a68b-16c2cd70a81c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:16.294195 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ea95c503-03e5-4ca3-a68b-16c2cd70a81c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:16.295156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ea95c503-03e5-4ca3-a68b-16c2cd70a81c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:16.295958 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ea95c503-03e5-4ca3-a68b-16c2cd70a81c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:16.413933 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-1f72eba9-f9db-4f77-9ce2-feb65d77f766 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:16.422022 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-1f72eba9-f9db-4f77-9ce2-feb65d77f766 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.173895 May 16 19:11:16.423243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 251/491] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:16 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:16.448915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ea95c503-03e5-4ca3-a68b-16c2cd70a81c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:16.457411 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ea95c503-03e5-4ca3-a68b-16c2cd70a81c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:16.458931 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ea95c503-03e5-4ca3-a68b-16c2cd70a81c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:16.460105 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ea95c503-03e5-4ca3-a68b-16c2cd70a81c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1753 microversion: 2.20 time: 0.185269 May 16 19:11:16.460663 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 241/492] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:16 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:16.742933 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b6b35f3f-1a3f-4049-abbb-c7d6a409f9f7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:16.744118 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b6b35f3f-1a3f-4049-abbb-c7d6a409f9f7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:16.754633 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b6b35f3f-1a3f-4049-abbb-c7d6a409f9f7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:16.754864 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b6b35f3f-1a3f-4049-abbb-c7d6a409f9f7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:16.755682 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b6b35f3f-1a3f-4049-abbb-c7d6a409f9f7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:16.756109 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b6b35f3f-1a3f-4049-abbb-c7d6a409f9f7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:16.832562 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3f46f7e0-26b0-4a19-a636-0bc84b162607 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-427318072", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1526048130", "security_groups": [{"name": "tempest-secgroup-smoke-1459527559"}], "networks": [{"uuid": "5aa18cd6-b394-4c2d-b694-bca5dc20e63c"}], "block_device_mapping_v2": [{"uuid": "bd6933c7-1f1a-46cd-be18-35450fbc5f1d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:16.888022 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b6b35f3f-1a3f-4049-abbb-c7d6a409f9f7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:16.896470 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b6b35f3f-1a3f-4049-abbb-c7d6a409f9f7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1318 microversion: 2.1 time: 0.159795 May 16 19:11:16.897045 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 252/493] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:16 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:16.943847 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.network.neutron [None req-3f46f7e0-26b0-4a19-a636-0bc84b162607 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] validate_networks() for [('5aa18cd6-b394-4c2d-b694-bca5dc20e63c', None, None, None, None, None)] {{(pid=117275) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:11:17.312652 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-3f46f7e0-26b0-4a19-a636-0bc84b162607 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Flavor limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:11:17.313450 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-3f46f7e0-26b0-4a19-a636-0bc84b162607 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Image limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:11:17.314234 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-3f46f7e0-26b0-4a19-a636-0bc84b162607 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Flavor pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:11:17.315154 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-3f46f7e0-26b0-4a19-a636-0bc84b162607 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Image pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:11:17.316270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-3f46f7e0-26b0-4a19-a636-0bc84b162607 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:11:17.331221 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3f46f7e0-26b0-4a19-a636-0bc84b162607 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:17.331722 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3f46f7e0-26b0-4a19-a636-0bc84b162607 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:17.332522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3f46f7e0-26b0-4a19-a636-0bc84b162607 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:17.333024 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3f46f7e0-26b0-4a19-a636-0bc84b162607 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:17.350883 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-3f46f7e0-26b0-4a19-a636-0bc84b162607 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Getting quotas for project 5e758da8d71142bdbac8765efccefde8. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:11:17.354806 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-3f46f7e0-26b0-4a19-a636-0bc84b162607 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Getting quotas for user 16afce4f51384e37b381171cbc2e0a82 and project 5e758da8d71142bdbac8765efccefde8. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:11:17.414141 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-3f46f7e0-26b0-4a19-a636-0bc84b162607 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Going to run 1 instances... {{(pid=117275) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:11:17.416371 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-3f46f7e0-26b0-4a19-a636-0bc84b162607 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd6933c7-1f1a-46cd-be18-35450fbc5f1d',volume_size=None,volume_type=None)] {{(pid=117275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:11:17.439730 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9955bbe4-863e-4ed9-acd9-ecfa6d62ee9d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:17.440461 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9955bbe4-863e-4ed9-acd9-ecfa6d62ee9d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:17.447813 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9955bbe4-863e-4ed9-acd9-ecfa6d62ee9d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:17.448277 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9955bbe4-863e-4ed9-acd9-ecfa6d62ee9d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:17.449153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9955bbe4-863e-4ed9-acd9-ecfa6d62ee9d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:17.449810 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9955bbe4-863e-4ed9-acd9-ecfa6d62ee9d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:17.548793 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-3f46f7e0-26b0-4a19-a636-0bc84b162607 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.719972 May 16 19:11:17.554397 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 242/494] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:11:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 19:11:17.554550 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b5364e50-2318-4774-a3b9-53ce6714af8b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:17.555122 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b5364e50-2318-4774-a3b9-53ce6714af8b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:17.563821 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b5364e50-2318-4774-a3b9-53ce6714af8b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:17.565436 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b5364e50-2318-4774-a3b9-53ce6714af8b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:17.566720 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b5364e50-2318-4774-a3b9-53ce6714af8b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:17.567166 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b5364e50-2318-4774-a3b9-53ce6714af8b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:17.595855 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9955bbe4-863e-4ed9-acd9-ecfa6d62ee9d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:17.604071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9955bbe4-863e-4ed9-acd9-ecfa6d62ee9d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.169249 May 16 19:11:17.604897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 253/495] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:17 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:17.609229 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-3c95e67c-9677-429e-a7dc-656c3311d80b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:17.609935 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-3c95e67c-9677-429e-a7dc-656c3311d80b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:17.663666 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-3c95e67c-9677-429e-a7dc-656c3311d80b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:17.670312 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-3c95e67c-9677-429e-a7dc-656c3311d80b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1088 microversion: 2.1 time: 0.064684 May 16 19:11:17.670890 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 254/496] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:17 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:17.699850 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b5364e50-2318-4774-a3b9-53ce6714af8b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:17.708694 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b5364e50-2318-4774-a3b9-53ce6714af8b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:17.710268 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b5364e50-2318-4774-a3b9-53ce6714af8b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:17.711442 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b5364e50-2318-4774-a3b9-53ce6714af8b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1753 microversion: 2.20 time: 0.161032 May 16 19:11:17.712008 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 243/497] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:17 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:17.914523 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-44ae9e0a-2eda-43fe-95c0-57be1a5a9366 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:17.915088 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-44ae9e0a-2eda-43fe-95c0-57be1a5a9366 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:17.924093 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-44ae9e0a-2eda-43fe-95c0-57be1a5a9366 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:17.924749 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-44ae9e0a-2eda-43fe-95c0-57be1a5a9366 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:17.930487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-44ae9e0a-2eda-43fe-95c0-57be1a5a9366 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:17.931168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-44ae9e0a-2eda-43fe-95c0-57be1a5a9366 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:18.147329 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-44ae9e0a-2eda-43fe-95c0-57be1a5a9366 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:18.155186 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-44ae9e0a-2eda-43fe-95c0-57be1a5a9366 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1508 microversion: 2.1 time: 0.245314 May 16 19:11:18.155843 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 255/498] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:17 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:18.620536 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-dbe464f4-2e43-42ca-85c8-245228bb71e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:18.621326 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-dbe464f4-2e43-42ca-85c8-245228bb71e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:18.627840 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dbe464f4-2e43-42ca-85c8-245228bb71e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:18.628400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dbe464f4-2e43-42ca-85c8-245228bb71e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:18.629180 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dbe464f4-2e43-42ca-85c8-245228bb71e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:18.629634 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dbe464f4-2e43-42ca-85c8-245228bb71e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:18.687115 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a7c63d6f-054a-457d-af42-a9aaed9e5aa7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:18.687748 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a7c63d6f-054a-457d-af42-a9aaed9e5aa7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:18.698658 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a7c63d6f-054a-457d-af42-a9aaed9e5aa7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:18.701498 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a7c63d6f-054a-457d-af42-a9aaed9e5aa7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:18.702591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a7c63d6f-054a-457d-af42-a9aaed9e5aa7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:18.703306 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a7c63d6f-054a-457d-af42-a9aaed9e5aa7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:18.813307 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a7c63d6f-054a-457d-af42-a9aaed9e5aa7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:18.821261 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a7c63d6f-054a-457d-af42-a9aaed9e5aa7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1186 microversion: 2.1 time: 0.138131 May 16 19:11:18.822043 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 256/499] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:18 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1186 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:11:18.826773 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-444d09e7-248a-48d7-9a4b-ec4861b558c2 req-83eaee30-62e0-4cdc-9adc-0efe7204eda9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb4d6c5-966a-44b0-a092-602b55ec665c", "tag": "2f53d2f3-16ec-408d-b308-a79d7b29c2e9"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:18.836821 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-444d09e7-248a-48d7-9a4b-ec4861b558c2 req-83eaee30-62e0-4cdc-9adc-0efe7204eda9 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:18.837415 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-444d09e7-248a-48d7-9a4b-ec4861b558c2 req-83eaee30-62e0-4cdc-9adc-0efe7204eda9 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:18.849598 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-444d09e7-248a-48d7-9a4b-ec4861b558c2 req-83eaee30-62e0-4cdc-9adc-0efe7204eda9 service nova] Creating event network-changed:2f53d2f3-16ec-408d-b308-a79d7b29c2e9 for instance eeb4d6c5-966a-44b0-a092-602b55ec665c on hv-cinder-76606 May 16 19:11:18.855150 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-444d09e7-248a-48d7-9a4b-ec4861b558c2 req-83eaee30-62e0-4cdc-9adc-0efe7204eda9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031800 May 16 19:11:18.855761 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 257/500] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:11:18.861587 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9981bcbc-9166-41b6-a734-a7f00cc2a6fc tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:18.862290 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9981bcbc-9166-41b6-a734-a7f00cc2a6fc tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:18.869178 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9981bcbc-9166-41b6-a734-a7f00cc2a6fc tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:18.869706 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9981bcbc-9166-41b6-a734-a7f00cc2a6fc tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:18.870489 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9981bcbc-9166-41b6-a734-a7f00cc2a6fc tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:18.870905 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9981bcbc-9166-41b6-a734-a7f00cc2a6fc tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:18.889216 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-dbe464f4-2e43-42ca-85c8-245228bb71e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:18.896937 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-dbe464f4-2e43-42ca-85c8-245228bb71e1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.280168 May 16 19:11:18.897725 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 244/501] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:18 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:19.102293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9981bcbc-9166-41b6-a734-a7f00cc2a6fc tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:19.112257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9981bcbc-9166-41b6-a734-a7f00cc2a6fc tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:19.113885 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9981bcbc-9166-41b6-a734-a7f00cc2a6fc tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:19.118186 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9981bcbc-9166-41b6-a734-a7f00cc2a6fc tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.261018 May 16 19:11:19.119953 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 258/502] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:18 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:19.838827 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b8becf61-5c60-4d43-952b-c848a3e28e8e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:19.839684 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b8becf61-5c60-4d43-952b-c848a3e28e8e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:19.846503 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b8becf61-5c60-4d43-952b-c848a3e28e8e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:19.847058 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b8becf61-5c60-4d43-952b-c848a3e28e8e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:19.847879 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b8becf61-5c60-4d43-952b-c848a3e28e8e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:19.848404 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b8becf61-5c60-4d43-952b-c848a3e28e8e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:19.914627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a44fb506-8c78-424f-8308-81c9ce3023c0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:19.915187 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a44fb506-8c78-424f-8308-81c9ce3023c0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:19.921909 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a44fb506-8c78-424f-8308-81c9ce3023c0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:19.922438 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a44fb506-8c78-424f-8308-81c9ce3023c0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:19.923217 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a44fb506-8c78-424f-8308-81c9ce3023c0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:19.923647 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a44fb506-8c78-424f-8308-81c9ce3023c0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:19.954722 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b8becf61-5c60-4d43-952b-c848a3e28e8e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:19.964730 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b8becf61-5c60-4d43-952b-c848a3e28e8e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1204 microversion: 2.1 time: 0.129639 May 16 19:11:19.965912 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 245/503] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:19 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1204 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:20.066288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a44fb506-8c78-424f-8308-81c9ce3023c0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:20.076216 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a44fb506-8c78-424f-8308-81c9ce3023c0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.165370 May 16 19:11:20.077201 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 259/504] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:19 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:20.137415 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-62ade0b0-6ff2-49a9-bcac-c32ca59f1592 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:20.138371 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-62ade0b0-6ff2-49a9-bcac-c32ca59f1592 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:20.144685 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-62ade0b0-6ff2-49a9-bcac-c32ca59f1592 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:20.145292 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-62ade0b0-6ff2-49a9-bcac-c32ca59f1592 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:20.146238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-62ade0b0-6ff2-49a9-bcac-c32ca59f1592 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:20.146813 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-62ade0b0-6ff2-49a9-bcac-c32ca59f1592 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:20.294842 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-62ade0b0-6ff2-49a9-bcac-c32ca59f1592 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:20.304490 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-62ade0b0-6ff2-49a9-bcac-c32ca59f1592 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:20.306338 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-62ade0b0-6ff2-49a9-bcac-c32ca59f1592 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:20.307533 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-62ade0b0-6ff2-49a9-bcac-c32ca59f1592 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.173989 May 16 19:11:20.319267 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 246/505] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:20 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:20.982635 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a1126242-e5a5-4948-bae3-ae06c02992c9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:20.983257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a1126242-e5a5-4948-bae3-ae06c02992c9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:20.991113 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a1126242-e5a5-4948-bae3-ae06c02992c9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:20.991649 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a1126242-e5a5-4948-bae3-ae06c02992c9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:20.992743 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a1126242-e5a5-4948-bae3-ae06c02992c9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:20.992963 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a1126242-e5a5-4948-bae3-ae06c02992c9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:21.094776 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3ae4fc98-6297-4a53-9da8-23dbc18b0652 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:21.096052 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-3ae4fc98-6297-4a53-9da8-23dbc18b0652 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:21.108179 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3ae4fc98-6297-4a53-9da8-23dbc18b0652 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:21.108930 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3ae4fc98-6297-4a53-9da8-23dbc18b0652 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:21.129912 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3ae4fc98-6297-4a53-9da8-23dbc18b0652 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:21.130650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3ae4fc98-6297-4a53-9da8-23dbc18b0652 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:21.293372 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a1126242-e5a5-4948-bae3-ae06c02992c9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:21.301170 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a1126242-e5a5-4948-bae3-ae06c02992c9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1192 microversion: 2.1 time: 0.322572 May 16 19:11:21.301885 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 260/506] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:20 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1192 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:21.326580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-04afd1e4-d82d-498d-b377-8db46bacb0ca tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:21.327578 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-04afd1e4-d82d-498d-b377-8db46bacb0ca tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:21.334523 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-04afd1e4-d82d-498d-b377-8db46bacb0ca tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:21.334961 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-04afd1e4-d82d-498d-b377-8db46bacb0ca tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:21.335765 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-04afd1e4-d82d-498d-b377-8db46bacb0ca tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:21.336198 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-04afd1e4-d82d-498d-b377-8db46bacb0ca tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:21.465359 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-3ae4fc98-6297-4a53-9da8-23dbc18b0652 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:21.478715 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-3ae4fc98-6297-4a53-9da8-23dbc18b0652 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.387561 May 16 19:11:21.492649 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 247/507] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:21 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:11:21.497236 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-04afd1e4-d82d-498d-b377-8db46bacb0ca tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:21.509020 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-04afd1e4-d82d-498d-b377-8db46bacb0ca tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:21.510959 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-04afd1e4-d82d-498d-b377-8db46bacb0ca tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:21.512108 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-04afd1e4-d82d-498d-b377-8db46bacb0ca tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.189777 May 16 19:11:21.521931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 261/508] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:21 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:22.318912 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d9933480-d6bd-47fb-99e6-8a05b6425fa3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:22.319522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d9933480-d6bd-47fb-99e6-8a05b6425fa3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:22.326109 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d9933480-d6bd-47fb-99e6-8a05b6425fa3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:22.326543 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d9933480-d6bd-47fb-99e6-8a05b6425fa3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:22.327303 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d9933480-d6bd-47fb-99e6-8a05b6425fa3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:22.327729 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d9933480-d6bd-47fb-99e6-8a05b6425fa3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:22.472643 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d9933480-d6bd-47fb-99e6-8a05b6425fa3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:22.480252 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d9933480-d6bd-47fb-99e6-8a05b6425fa3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.165246 May 16 19:11:22.480821 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 248/509] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:22 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:22.498329 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5e38fd67-d33e-40ce-90a5-5a3783560987 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:22.498949 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5e38fd67-d33e-40ce-90a5-5a3783560987 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:22.505877 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5e38fd67-d33e-40ce-90a5-5a3783560987 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:22.506329 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5e38fd67-d33e-40ce-90a5-5a3783560987 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:22.507102 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5e38fd67-d33e-40ce-90a5-5a3783560987 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:22.507540 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5e38fd67-d33e-40ce-90a5-5a3783560987 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:22.530777 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e961ba9e-dd59-40cc-b618-4d5b96e3d363 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:22.531390 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e961ba9e-dd59-40cc-b618-4d5b96e3d363 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:22.537576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e961ba9e-dd59-40cc-b618-4d5b96e3d363 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:22.538036 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e961ba9e-dd59-40cc-b618-4d5b96e3d363 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:22.538816 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e961ba9e-dd59-40cc-b618-4d5b96e3d363 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:22.539252 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e961ba9e-dd59-40cc-b618-4d5b96e3d363 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:22.650735 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-5e38fd67-d33e-40ce-90a5-5a3783560987 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:22.658753 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-5e38fd67-d33e-40ce-90a5-5a3783560987 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.165749 May 16 19:11:22.661583 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 262/510] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:22 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:22.712531 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e961ba9e-dd59-40cc-b618-4d5b96e3d363 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:22.721448 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e961ba9e-dd59-40cc-b618-4d5b96e3d363 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:22.722899 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e961ba9e-dd59-40cc-b618-4d5b96e3d363 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:22.724060 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e961ba9e-dd59-40cc-b618-4d5b96e3d363 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.197165 May 16 19:11:22.724618 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 249/511] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:22 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:23.441265 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-5c128214-d814-453b-8ec1-16150e007519 req-dd9aab50-0b5e-418f-9d71-288a7edeeac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a385b0-58f3-4946-b6c6-2cbd20fe387f", "tag": "aadd3356-5374-4e27-aec5-d1a129d4438b"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:23.451905 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-5c128214-d814-453b-8ec1-16150e007519 req-dd9aab50-0b5e-418f-9d71-288a7edeeac3 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:23.452351 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-5c128214-d814-453b-8ec1-16150e007519 req-dd9aab50-0b5e-418f-9d71-288a7edeeac3 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:23.475137 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-5c128214-d814-453b-8ec1-16150e007519 req-dd9aab50-0b5e-418f-9d71-288a7edeeac3 service nova] Creating event network-changed:aadd3356-5374-4e27-aec5-d1a129d4438b for instance 96a385b0-58f3-4946-b6c6-2cbd20fe387f on hv-cinder-76606 May 16 19:11:23.483546 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-5c128214-d814-453b-8ec1-16150e007519 req-dd9aab50-0b5e-418f-9d71-288a7edeeac3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046953 May 16 19:11:23.484912 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 263/512] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:11:23.499009 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-64e467bc-36b5-4d06-b19b-819bff108441 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:23.499638 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-64e467bc-36b5-4d06-b19b-819bff108441 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:23.507371 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-64e467bc-36b5-4d06-b19b-819bff108441 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:23.508070 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-64e467bc-36b5-4d06-b19b-819bff108441 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:23.509049 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-64e467bc-36b5-4d06-b19b-819bff108441 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:23.509738 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-64e467bc-36b5-4d06-b19b-819bff108441 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:23.680273 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-11852c05-c469-4f30-bab5-d52bb7c36420 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:23.681027 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-11852c05-c469-4f30-bab5-d52bb7c36420 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:23.696213 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-11852c05-c469-4f30-bab5-d52bb7c36420 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:23.696849 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-11852c05-c469-4f30-bab5-d52bb7c36420 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:23.698984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-11852c05-c469-4f30-bab5-d52bb7c36420 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:23.699588 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-11852c05-c469-4f30-bab5-d52bb7c36420 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:23.709187 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-64e467bc-36b5-4d06-b19b-819bff108441 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:23.717478 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-64e467bc-36b5-4d06-b19b-819bff108441 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.222749 May 16 19:11:23.729365 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 250/513] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:23 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:23.749083 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-09e0b97c-9c53-4951-aa7f-5a7579ef6014 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:23.749629 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-09e0b97c-9c53-4951-aa7f-5a7579ef6014 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:23.756377 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-09e0b97c-9c53-4951-aa7f-5a7579ef6014 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:23.757051 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-09e0b97c-9c53-4951-aa7f-5a7579ef6014 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:23.758042 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-09e0b97c-9c53-4951-aa7f-5a7579ef6014 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:23.758642 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-09e0b97c-9c53-4951-aa7f-5a7579ef6014 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:23.860306 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-11852c05-c469-4f30-bab5-d52bb7c36420 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:23.868874 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-11852c05-c469-4f30-bab5-d52bb7c36420 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.193860 May 16 19:11:23.870059 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 264/514] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:23 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:23.906790 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-09e0b97c-9c53-4951-aa7f-5a7579ef6014 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:23.916788 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-09e0b97c-9c53-4951-aa7f-5a7579ef6014 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:23.918537 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-09e0b97c-9c53-4951-aa7f-5a7579ef6014 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:23.919914 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-09e0b97c-9c53-4951-aa7f-5a7579ef6014 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.175769 May 16 19:11:23.920478 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 251/515] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:23 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:24.736759 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-962cf492-bf07-40fe-b284-596e4abdd458 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:24.737852 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-962cf492-bf07-40fe-b284-596e4abdd458 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:24.746131 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-962cf492-bf07-40fe-b284-596e4abdd458 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:24.746584 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-962cf492-bf07-40fe-b284-596e4abdd458 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:24.747390 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-962cf492-bf07-40fe-b284-596e4abdd458 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:24.748150 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-962cf492-bf07-40fe-b284-596e4abdd458 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:24.887092 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-6b17ff98-0baf-4b84-ad9f-69fa4d61cc1c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:24.887861 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-6b17ff98-0baf-4b84-ad9f-69fa4d61cc1c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:24.911922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6b17ff98-0baf-4b84-ad9f-69fa4d61cc1c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:24.912680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6b17ff98-0baf-4b84-ad9f-69fa4d61cc1c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:24.913693 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6b17ff98-0baf-4b84-ad9f-69fa4d61cc1c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:24.914364 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6b17ff98-0baf-4b84-ad9f-69fa4d61cc1c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:24.937225 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-962cf492-bf07-40fe-b284-596e4abdd458 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:24.954157 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-962cf492-bf07-40fe-b284-596e4abdd458 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.221769 May 16 19:11:24.954736 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 265/516] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:24 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:24.959621 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-15cb8bdc-bb8e-4da9-a819-2c4aa170997f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:24.960491 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-15cb8bdc-bb8e-4da9-a819-2c4aa170997f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:24.967158 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-15cb8bdc-bb8e-4da9-a819-2c4aa170997f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:24.967836 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-15cb8bdc-bb8e-4da9-a819-2c4aa170997f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:24.968771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-15cb8bdc-bb8e-4da9-a819-2c4aa170997f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:24.969355 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-15cb8bdc-bb8e-4da9-a819-2c4aa170997f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:25.135916 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6b17ff98-0baf-4b84-ad9f-69fa4d61cc1c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:25.144997 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-6b17ff98-0baf-4b84-ad9f-69fa4d61cc1c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.261637 May 16 19:11:25.146295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 252/517] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:24 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:11:25.153453 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-15cb8bdc-bb8e-4da9-a819-2c4aa170997f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:25.168052 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-15cb8bdc-bb8e-4da9-a819-2c4aa170997f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:25.170019 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-15cb8bdc-bb8e-4da9-a819-2c4aa170997f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:25.172031 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-15cb8bdc-bb8e-4da9-a819-2c4aa170997f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.216063 May 16 19:11:25.173133 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 266/518] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:24 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:25.973679 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4b66bef8-98a2-4f4e-adcd-3085acbb4ad9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:25.974334 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-4b66bef8-98a2-4f4e-adcd-3085acbb4ad9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:25.981332 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4b66bef8-98a2-4f4e-adcd-3085acbb4ad9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:25.981812 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4b66bef8-98a2-4f4e-adcd-3085acbb4ad9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:25.982591 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4b66bef8-98a2-4f4e-adcd-3085acbb4ad9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:25.983022 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4b66bef8-98a2-4f4e-adcd-3085acbb4ad9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:26.121219 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4b66bef8-98a2-4f4e-adcd-3085acbb4ad9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:26.128785 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4b66bef8-98a2-4f4e-adcd-3085acbb4ad9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.160535 May 16 19:11:26.129444 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 253/519] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:25 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:26.168564 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-90ccceab-4fbe-4d51-9288-38b945f42760 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:26.169305 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-90ccceab-4fbe-4d51-9288-38b945f42760 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:26.175889 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-90ccceab-4fbe-4d51-9288-38b945f42760 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:26.176395 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-90ccceab-4fbe-4d51-9288-38b945f42760 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:26.177172 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-90ccceab-4fbe-4d51-9288-38b945f42760 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:26.177624 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-90ccceab-4fbe-4d51-9288-38b945f42760 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:26.190504 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4c4dc940-fbd3-4e98-bfe0-15fbbdbcf676 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:26.191631 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-4c4dc940-fbd3-4e98-bfe0-15fbbdbcf676 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:26.205369 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4c4dc940-fbd3-4e98-bfe0-15fbbdbcf676 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:26.206304 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4c4dc940-fbd3-4e98-bfe0-15fbbdbcf676 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:26.207421 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4c4dc940-fbd3-4e98-bfe0-15fbbdbcf676 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:26.208007 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4c4dc940-fbd3-4e98-bfe0-15fbbdbcf676 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:26.313332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-90ccceab-4fbe-4d51-9288-38b945f42760 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:26.324203 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-90ccceab-4fbe-4d51-9288-38b945f42760 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.165533 May 16 19:11:26.324798 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 267/520] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:26 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:26.366423 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4c4dc940-fbd3-4e98-bfe0-15fbbdbcf676 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:26.375785 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4c4dc940-fbd3-4e98-bfe0-15fbbdbcf676 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:26.377458 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4c4dc940-fbd3-4e98-bfe0-15fbbdbcf676 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:26.378969 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4c4dc940-fbd3-4e98-bfe0-15fbbdbcf676 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.192839 May 16 19:11:26.390609 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 254/521] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:26 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:11:26.774259 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-fe4ee23f-decb-402b-aa38-702899d92714 req-3b5f8e14-caa0-4aeb-ba9b-5ac772989f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb4d6c5-966a-44b0-a092-602b55ec665c", "name": "network-vif-plugged", "status": "completed", "tag": "2f53d2f3-16ec-408d-b308-a79d7b29c2e9"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:26.783693 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-fe4ee23f-decb-402b-aa38-702899d92714 req-3b5f8e14-caa0-4aeb-ba9b-5ac772989f6a service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:26.784247 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-fe4ee23f-decb-402b-aa38-702899d92714 req-3b5f8e14-caa0-4aeb-ba9b-5ac772989f6a service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:26.801203 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-fe4ee23f-decb-402b-aa38-702899d92714 req-3b5f8e14-caa0-4aeb-ba9b-5ac772989f6a service nova] Creating event network-vif-plugged:2f53d2f3-16ec-408d-b308-a79d7b29c2e9 for instance eeb4d6c5-966a-44b0-a092-602b55ec665c on hv-cinder-76606 May 16 19:11:26.806417 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-fe4ee23f-decb-402b-aa38-702899d92714 req-3b5f8e14-caa0-4aeb-ba9b-5ac772989f6a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036075 May 16 19:11:26.807413 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 268/522] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:11:27.147492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-dda27f7f-07e1-46a6-afd2-e7f71482ba38 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:27.148485 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-dda27f7f-07e1-46a6-afd2-e7f71482ba38 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:27.156796 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dda27f7f-07e1-46a6-afd2-e7f71482ba38 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:27.157871 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dda27f7f-07e1-46a6-afd2-e7f71482ba38 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:27.159190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dda27f7f-07e1-46a6-afd2-e7f71482ba38 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:27.163918 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dda27f7f-07e1-46a6-afd2-e7f71482ba38 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:27.319119 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-dda27f7f-07e1-46a6-afd2-e7f71482ba38 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:27.326833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-dda27f7f-07e1-46a6-afd2-e7f71482ba38 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.183371 May 16 19:11:27.327489 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 255/523] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:27 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:27.343519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-189170dc-a93c-4d42-86ea-581f51952241 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:27.344216 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-189170dc-a93c-4d42-86ea-581f51952241 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:27.351822 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-189170dc-a93c-4d42-86ea-581f51952241 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:27.352553 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-189170dc-a93c-4d42-86ea-581f51952241 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:27.353575 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-189170dc-a93c-4d42-86ea-581f51952241 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:27.354198 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-189170dc-a93c-4d42-86ea-581f51952241 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:27.399093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-cb6d7556-153f-4f73-9155-1b319f69fde2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:27.400827 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-cb6d7556-153f-4f73-9155-1b319f69fde2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:27.407473 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cb6d7556-153f-4f73-9155-1b319f69fde2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:27.408311 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cb6d7556-153f-4f73-9155-1b319f69fde2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:27.409151 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cb6d7556-153f-4f73-9155-1b319f69fde2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:27.409615 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cb6d7556-153f-4f73-9155-1b319f69fde2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:27.502697 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-189170dc-a93c-4d42-86ea-581f51952241 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:27.511481 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-189170dc-a93c-4d42-86ea-581f51952241 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.172693 May 16 19:11:27.512053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 269/524] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:27 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:27.563593 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-cb6d7556-153f-4f73-9155-1b319f69fde2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:27.573941 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-cb6d7556-153f-4f73-9155-1b319f69fde2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:27.575423 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-cb6d7556-153f-4f73-9155-1b319f69fde2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:27.576631 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-cb6d7556-153f-4f73-9155-1b319f69fde2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.182382 May 16 19:11:27.577189 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 256/525] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:27 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:11:28.344426 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ec8df906-ff9b-42ca-85eb-d817d511ff8e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:28.345168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ec8df906-ff9b-42ca-85eb-d817d511ff8e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:28.352101 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec8df906-ff9b-42ca-85eb-d817d511ff8e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:28.352538 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec8df906-ff9b-42ca-85eb-d817d511ff8e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:28.353312 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec8df906-ff9b-42ca-85eb-d817d511ff8e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:28.353738 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec8df906-ff9b-42ca-85eb-d817d511ff8e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:28.512276 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ec8df906-ff9b-42ca-85eb-d817d511ff8e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:28.520514 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ec8df906-ff9b-42ca-85eb-d817d511ff8e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.179945 May 16 19:11:28.521142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 270/526] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:28 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:28.529705 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f3eebac3-9c46-4204-ac0d-02772e51ddd2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:28.531115 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f3eebac3-9c46-4204-ac0d-02772e51ddd2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:28.538201 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f3eebac3-9c46-4204-ac0d-02772e51ddd2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:28.538648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f3eebac3-9c46-4204-ac0d-02772e51ddd2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:28.539488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f3eebac3-9c46-4204-ac0d-02772e51ddd2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:28.539924 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f3eebac3-9c46-4204-ac0d-02772e51ddd2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:28.594990 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c619852a-baea-4d5a-955d-ec63862df571 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:28.595524 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c619852a-baea-4d5a-955d-ec63862df571 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:28.602694 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c619852a-baea-4d5a-955d-ec63862df571 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:28.603119 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c619852a-baea-4d5a-955d-ec63862df571 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:28.604058 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c619852a-baea-4d5a-955d-ec63862df571 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:28.606546 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c619852a-baea-4d5a-955d-ec63862df571 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:28.682408 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f3eebac3-9c46-4204-ac0d-02772e51ddd2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:28.690378 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f3eebac3-9c46-4204-ac0d-02772e51ddd2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.165638 May 16 19:11:28.690993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 257/527] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:28 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:28.779463 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c619852a-baea-4d5a-955d-ec63862df571 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:28.788231 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c619852a-baea-4d5a-955d-ec63862df571 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:28.789987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c619852a-baea-4d5a-955d-ec63862df571 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:28.791194 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c619852a-baea-4d5a-955d-ec63862df571 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.200216 May 16 19:11:28.791799 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 271/528] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:28 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:29.539489 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-19939f23-8ba1-459b-9c9d-bb25caaec4cf tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:29.540183 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-19939f23-8ba1-459b-9c9d-bb25caaec4cf tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:29.547808 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-19939f23-8ba1-459b-9c9d-bb25caaec4cf tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:29.548242 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-19939f23-8ba1-459b-9c9d-bb25caaec4cf tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:29.549061 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-19939f23-8ba1-459b-9c9d-bb25caaec4cf tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:29.549452 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-19939f23-8ba1-459b-9c9d-bb25caaec4cf tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:29.708267 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-18f7660f-1bd3-4add-9c5d-1a54029bda6a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:29.708889 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-18f7660f-1bd3-4add-9c5d-1a54029bda6a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:29.709413 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-19939f23-8ba1-459b-9c9d-bb25caaec4cf tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:29.715833 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-18f7660f-1bd3-4add-9c5d-1a54029bda6a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:29.716610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-18f7660f-1bd3-4add-9c5d-1a54029bda6a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:29.717658 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-18f7660f-1bd3-4add-9c5d-1a54029bda6a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:29.718094 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-19939f23-8ba1-459b-9c9d-bb25caaec4cf tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.183321 May 16 19:11:29.718528 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-18f7660f-1bd3-4add-9c5d-1a54029bda6a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:29.726328 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 258/529] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:29 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:29.811625 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5eec07f7-ec69-47d1-9d61-9a323545c85d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:29.812510 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5eec07f7-ec69-47d1-9d61-9a323545c85d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:29.818960 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5eec07f7-ec69-47d1-9d61-9a323545c85d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:29.819627 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5eec07f7-ec69-47d1-9d61-9a323545c85d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:29.820560 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5eec07f7-ec69-47d1-9d61-9a323545c85d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:29.821139 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5eec07f7-ec69-47d1-9d61-9a323545c85d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:29.896563 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-18f7660f-1bd3-4add-9c5d-1a54029bda6a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:29.907061 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-18f7660f-1bd3-4add-9c5d-1a54029bda6a tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.203194 May 16 19:11:29.907845 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 272/530] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:29 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:11:29.968315 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5eec07f7-ec69-47d1-9d61-9a323545c85d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:29.976679 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5eec07f7-ec69-47d1-9d61-9a323545c85d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:29.978354 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5eec07f7-ec69-47d1-9d61-9a323545c85d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:29.979672 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5eec07f7-ec69-47d1-9d61-9a323545c85d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.172792 May 16 19:11:29.980243 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 259/531] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:29 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:11:30.736106 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e3872aa4-8fe5-434b-8975-e609bb9abc1e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:30.736724 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e3872aa4-8fe5-434b-8975-e609bb9abc1e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:30.744067 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e3872aa4-8fe5-434b-8975-e609bb9abc1e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:30.744523 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e3872aa4-8fe5-434b-8975-e609bb9abc1e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:30.745329 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e3872aa4-8fe5-434b-8975-e609bb9abc1e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:30.745785 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e3872aa4-8fe5-434b-8975-e609bb9abc1e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:30.898408 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e3872aa4-8fe5-434b-8975-e609bb9abc1e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:30.907122 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e3872aa4-8fe5-434b-8975-e609bb9abc1e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.174864 May 16 19:11:30.907709 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 273/532] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:30 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:30.924209 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-7946de76-6150-4b7a-9437-f52d73c1db4f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:30.924814 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-7946de76-6150-4b7a-9437-f52d73c1db4f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:30.931661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7946de76-6150-4b7a-9437-f52d73c1db4f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:30.932099 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7946de76-6150-4b7a-9437-f52d73c1db4f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:30.933115 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7946de76-6150-4b7a-9437-f52d73c1db4f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:30.933575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7946de76-6150-4b7a-9437-f52d73c1db4f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:30.998578 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-29dafcfa-820e-4014-b069-71491efc19ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:30.999106 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-29dafcfa-820e-4014-b069-71491efc19ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:31.005309 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-29dafcfa-820e-4014-b069-71491efc19ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:31.006137 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-29dafcfa-820e-4014-b069-71491efc19ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:31.007185 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-29dafcfa-820e-4014-b069-71491efc19ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:31.007830 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-29dafcfa-820e-4014-b069-71491efc19ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:31.086164 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-7946de76-6150-4b7a-9437-f52d73c1db4f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:31.093878 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-7946de76-6150-4b7a-9437-f52d73c1db4f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.173425 May 16 19:11:31.099509 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 260/533] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:30 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:31.149098 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-29dafcfa-820e-4014-b069-71491efc19ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:31.159250 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-29dafcfa-820e-4014-b069-71491efc19ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:31.160952 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-29dafcfa-820e-4014-b069-71491efc19ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:31.162287 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-29dafcfa-820e-4014-b069-71491efc19ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.167772 May 16 19:11:31.162919 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 274/534] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:30 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:11:31.924396 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9fe34c5f-9c8b-4396-9c3f-ed7153902a67 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:31.925798 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9fe34c5f-9c8b-4396-9c3f-ed7153902a67 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:31.932583 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9fe34c5f-9c8b-4396-9c3f-ed7153902a67 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:31.933037 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9fe34c5f-9c8b-4396-9c3f-ed7153902a67 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:31.934016 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9fe34c5f-9c8b-4396-9c3f-ed7153902a67 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:31.934450 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9fe34c5f-9c8b-4396-9c3f-ed7153902a67 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:32.069743 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-9fe34c5f-9c8b-4396-9c3f-ed7153902a67 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:32.077761 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9fe34c5f-9c8b-4396-9c3f-ed7153902a67 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.157378 May 16 19:11:32.078306 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 261/535] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:31 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:32.111270 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2ac6910e-8b4d-4d1c-81ab-eae2f10a3c5c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:32.112590 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2ac6910e-8b4d-4d1c-81ab-eae2f10a3c5c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:32.119946 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2ac6910e-8b4d-4d1c-81ab-eae2f10a3c5c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:32.121141 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2ac6910e-8b4d-4d1c-81ab-eae2f10a3c5c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:32.122364 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2ac6910e-8b4d-4d1c-81ab-eae2f10a3c5c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:32.123070 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2ac6910e-8b4d-4d1c-81ab-eae2f10a3c5c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:32.180707 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-2ad18175-6fec-4a7e-8570-d962124aa79e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:32.181266 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-2ad18175-6fec-4a7e-8570-d962124aa79e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:32.187670 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2ad18175-6fec-4a7e-8570-d962124aa79e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:32.188141 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2ad18175-6fec-4a7e-8570-d962124aa79e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:32.188918 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2ad18175-6fec-4a7e-8570-d962124aa79e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:32.189353 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2ad18175-6fec-4a7e-8570-d962124aa79e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:32.270050 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2ac6910e-8b4d-4d1c-81ab-eae2f10a3c5c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:32.280557 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2ac6910e-8b4d-4d1c-81ab-eae2f10a3c5c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.173741 May 16 19:11:32.288465 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 275/536] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:32 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:32.330959 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-2ad18175-6fec-4a7e-8570-d962124aa79e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:32.339880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-2ad18175-6fec-4a7e-8570-d962124aa79e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:32.341417 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-2ad18175-6fec-4a7e-8570-d962124aa79e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:32.342663 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-2ad18175-6fec-4a7e-8570-d962124aa79e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.166187 May 16 19:11:32.343224 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 262/537] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:32 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:11:33.096448 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4fa8f3cb-1f4f-4756-b998-971ebb75c93d tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:33.097166 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-4fa8f3cb-1f4f-4756-b998-971ebb75c93d tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:33.104380 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4fa8f3cb-1f4f-4756-b998-971ebb75c93d tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:33.104833 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4fa8f3cb-1f4f-4756-b998-971ebb75c93d tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:33.105660 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4fa8f3cb-1f4f-4756-b998-971ebb75c93d tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:33.106099 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4fa8f3cb-1f4f-4756-b998-971ebb75c93d tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:33.242766 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4fa8f3cb-1f4f-4756-b998-971ebb75c93d tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:33.250534 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4fa8f3cb-1f4f-4756-b998-971ebb75c93d tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.158769 May 16 19:11:33.251078 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 276/538] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:33 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:33.297707 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-20d6e091-46b2-4ad7-bee9-751ee25bc848 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:33.298340 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-20d6e091-46b2-4ad7-bee9-751ee25bc848 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:33.305133 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-20d6e091-46b2-4ad7-bee9-751ee25bc848 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:33.305610 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-20d6e091-46b2-4ad7-bee9-751ee25bc848 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:33.306382 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-20d6e091-46b2-4ad7-bee9-751ee25bc848 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:33.306821 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-20d6e091-46b2-4ad7-bee9-751ee25bc848 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:33.360655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c889d538-9a2f-4952-980e-6f96300cd6e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:33.361214 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c889d538-9a2f-4952-980e-6f96300cd6e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:33.367639 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c889d538-9a2f-4952-980e-6f96300cd6e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:33.368091 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c889d538-9a2f-4952-980e-6f96300cd6e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:33.368868 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c889d538-9a2f-4952-980e-6f96300cd6e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:33.369308 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c889d538-9a2f-4952-980e-6f96300cd6e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:33.442095 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-20d6e091-46b2-4ad7-bee9-751ee25bc848 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:33.449974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-20d6e091-46b2-4ad7-bee9-751ee25bc848 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.156161 May 16 19:11:33.450884 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 263/539] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:33 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:33.504499 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c889d538-9a2f-4952-980e-6f96300cd6e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:33.512897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c889d538-9a2f-4952-980e-6f96300cd6e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:33.514409 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c889d538-9a2f-4952-980e-6f96300cd6e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:33.515569 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c889d538-9a2f-4952-980e-6f96300cd6e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.159010 May 16 19:11:33.516124 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 277/540] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:33 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:34.273827 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9551bf6f-8e21-46f2-b032-e5f1e3eb7ec3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:34.275134 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9551bf6f-8e21-46f2-b032-e5f1e3eb7ec3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:34.285220 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9551bf6f-8e21-46f2-b032-e5f1e3eb7ec3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:34.285691 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9551bf6f-8e21-46f2-b032-e5f1e3eb7ec3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:34.286504 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9551bf6f-8e21-46f2-b032-e5f1e3eb7ec3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:34.286925 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9551bf6f-8e21-46f2-b032-e5f1e3eb7ec3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:34.436126 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-9551bf6f-8e21-46f2-b032-e5f1e3eb7ec3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:34.443546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9551bf6f-8e21-46f2-b032-e5f1e3eb7ec3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.178190 May 16 19:11:34.444085 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 264/541] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:34 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:34.466805 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-05fe2d65-7695-45bc-96f5-edcfda3d2ea5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:34.467419 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-05fe2d65-7695-45bc-96f5-edcfda3d2ea5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:34.474012 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-05fe2d65-7695-45bc-96f5-edcfda3d2ea5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:34.474459 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-05fe2d65-7695-45bc-96f5-edcfda3d2ea5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:34.475265 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-05fe2d65-7695-45bc-96f5-edcfda3d2ea5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:34.475697 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-05fe2d65-7695-45bc-96f5-edcfda3d2ea5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:34.534270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4963e66a-d80f-44c7-8a4b-76d3d9f47787 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:34.534977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-4963e66a-d80f-44c7-8a4b-76d3d9f47787 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:34.541723 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4963e66a-d80f-44c7-8a4b-76d3d9f47787 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:34.542197 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4963e66a-d80f-44c7-8a4b-76d3d9f47787 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:34.542945 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4963e66a-d80f-44c7-8a4b-76d3d9f47787 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:34.543372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4963e66a-d80f-44c7-8a4b-76d3d9f47787 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:34.619233 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-05fe2d65-7695-45bc-96f5-edcfda3d2ea5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:34.629071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-05fe2d65-7695-45bc-96f5-edcfda3d2ea5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.166136 May 16 19:11:34.629791 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 278/542] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:34 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:34.672403 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4963e66a-d80f-44c7-8a4b-76d3d9f47787 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:34.685590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4963e66a-d80f-44c7-8a4b-76d3d9f47787 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:34.688173 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4963e66a-d80f-44c7-8a4b-76d3d9f47787 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:34.689844 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4963e66a-d80f-44c7-8a4b-76d3d9f47787 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.159309 May 16 19:11:34.690544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 265/543] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:34 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:35.464342 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-6c6e25c8-68fb-47ce-8ca9-322233364abc tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:35.465161 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-6c6e25c8-68fb-47ce-8ca9-322233364abc tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:35.474833 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6c6e25c8-68fb-47ce-8ca9-322233364abc tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:35.475363 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6c6e25c8-68fb-47ce-8ca9-322233364abc tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:35.476038 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6c6e25c8-68fb-47ce-8ca9-322233364abc tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:35.476471 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6c6e25c8-68fb-47ce-8ca9-322233364abc tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:35.619614 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-6c6e25c8-68fb-47ce-8ca9-322233364abc tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:35.627358 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-6c6e25c8-68fb-47ce-8ca9-322233364abc tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.169420 May 16 19:11:35.627930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 279/544] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:35 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:35.646643 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b974e481-e759-43ac-a7e8-d4d5c919d0a7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:35.647290 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b974e481-e759-43ac-a7e8-d4d5c919d0a7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:35.655070 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b974e481-e759-43ac-a7e8-d4d5c919d0a7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:35.655510 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b974e481-e759-43ac-a7e8-d4d5c919d0a7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:35.656288 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b974e481-e759-43ac-a7e8-d4d5c919d0a7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:35.656726 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b974e481-e759-43ac-a7e8-d4d5c919d0a7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:35.709183 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e48959d1-8a9b-4a42-937a-49516148e03d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:35.709830 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e48959d1-8a9b-4a42-937a-49516148e03d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:35.716233 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e48959d1-8a9b-4a42-937a-49516148e03d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:35.716600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e48959d1-8a9b-4a42-937a-49516148e03d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:35.717371 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e48959d1-8a9b-4a42-937a-49516148e03d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:35.717832 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e48959d1-8a9b-4a42-937a-49516148e03d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:35.850603 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e48959d1-8a9b-4a42-937a-49516148e03d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:35.859792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e48959d1-8a9b-4a42-937a-49516148e03d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:35.861363 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e48959d1-8a9b-4a42-937a-49516148e03d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:35.862732 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e48959d1-8a9b-4a42-937a-49516148e03d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.157486 May 16 19:11:35.863271 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 280/545] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:35 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:11:36.093303 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b974e481-e759-43ac-a7e8-d4d5c919d0a7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:36.101486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b974e481-e759-43ac-a7e8-d4d5c919d0a7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.458876 May 16 19:11:36.102098 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 266/546] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:35 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:36.644451 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-cb54bfa8-6829-4be4-b8a4-62d25a9baeb5 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:36.647635 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-cb54bfa8-6829-4be4-b8a4-62d25a9baeb5 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:36.654633 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cb54bfa8-6829-4be4-b8a4-62d25a9baeb5 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:36.655087 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cb54bfa8-6829-4be4-b8a4-62d25a9baeb5 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:36.655835 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cb54bfa8-6829-4be4-b8a4-62d25a9baeb5 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:36.656457 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cb54bfa8-6829-4be4-b8a4-62d25a9baeb5 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:36.790038 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-cb54bfa8-6829-4be4-b8a4-62d25a9baeb5 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:36.797780 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-cb54bfa8-6829-4be4-b8a4-62d25a9baeb5 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.157282 May 16 19:11:36.798455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 281/547] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:36 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:36.881344 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-fe9c16b5-ebde-488b-a720-e62ea7e5e694 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:36.882440 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-fe9c16b5-ebde-488b-a720-e62ea7e5e694 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:36.890920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fe9c16b5-ebde-488b-a720-e62ea7e5e694 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:36.891366 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fe9c16b5-ebde-488b-a720-e62ea7e5e694 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:36.892137 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fe9c16b5-ebde-488b-a720-e62ea7e5e694 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:36.892571 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fe9c16b5-ebde-488b-a720-e62ea7e5e694 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:37.027061 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-fe9c16b5-ebde-488b-a720-e62ea7e5e694 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:37.039370 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-fe9c16b5-ebde-488b-a720-e62ea7e5e694 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:37.040875 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-fe9c16b5-ebde-488b-a720-e62ea7e5e694 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:37.042155 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-fe9c16b5-ebde-488b-a720-e62ea7e5e694 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.164966 May 16 19:11:37.042984 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 267/548] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:36 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:37.118667 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d501914c-48d8-46ae-a132-833883abedbb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:37.119278 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d501914c-48d8-46ae-a132-833883abedbb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:37.125904 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d501914c-48d8-46ae-a132-833883abedbb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:37.126355 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d501914c-48d8-46ae-a132-833883abedbb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:37.127127 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d501914c-48d8-46ae-a132-833883abedbb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:37.127559 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d501914c-48d8-46ae-a132-833883abedbb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:37.258598 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d501914c-48d8-46ae-a132-833883abedbb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:37.267078 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d501914c-48d8-46ae-a132-833883abedbb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1370 microversion: 2.1 time: 0.152347 May 16 19:11:37.267652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 282/549] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:37 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:37.762207 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-26a72641-aaab-4641-9052-b1a190f11ec4 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dccfb195-cbd7-4ae8-8a39-a381806f2a18", "device": "/dev/sdb"}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:37.763874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-26a72641-aaab-4641-9052-b1a190f11ec4 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:37.770004 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-26a72641-aaab-4641-9052-b1a190f11ec4 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:37.770445 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-26a72641-aaab-4641-9052-b1a190f11ec4 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:37.771215 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-26a72641-aaab-4641-9052-b1a190f11ec4 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:37.771677 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-26a72641-aaab-4641-9052-b1a190f11ec4 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:37.814667 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5f9bd9ec-84ae-45f5-972b-d8526debbadb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:37.815390 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5f9bd9ec-84ae-45f5-972b-d8526debbadb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:37.822162 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5f9bd9ec-84ae-45f5-972b-d8526debbadb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:37.822611 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5f9bd9ec-84ae-45f5-972b-d8526debbadb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:37.823423 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5f9bd9ec-84ae-45f5-972b-d8526debbadb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:37.823848 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5f9bd9ec-84ae-45f5-972b-d8526debbadb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:37.953942 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-5f9bd9ec-84ae-45f5-972b-d8526debbadb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:37.962988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-5f9bd9ec-84ae-45f5-972b-d8526debbadb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.152082 May 16 19:11:37.963537 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 283/550] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:37 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:38.060324 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d2b32b96-af95-4678-84c7-8c611f28622b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:38.060922 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d2b32b96-af95-4678-84c7-8c611f28622b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:38.067251 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d2b32b96-af95-4678-84c7-8c611f28622b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:38.067738 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d2b32b96-af95-4678-84c7-8c611f28622b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:38.068648 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d2b32b96-af95-4678-84c7-8c611f28622b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:38.069093 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d2b32b96-af95-4678-84c7-8c611f28622b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:38.133179 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-26a72641-aaab-4641-9052-b1a190f11ec4 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "POST /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.374817 May 16 19:11:38.138554 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 268/551] 10.222.0.24 () {60 vars in 1322 bytes} [Mon May 16 19:11:37 2022] POST /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:11:38.212311 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d2b32b96-af95-4678-84c7-8c611f28622b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:38.220985 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d2b32b96-af95-4678-84c7-8c611f28622b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:38.222498 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d2b32b96-af95-4678-84c7-8c611f28622b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:38.223669 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d2b32b96-af95-4678-84c7-8c611f28622b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.167331 May 16 19:11:38.224224 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 284/552] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:38 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:38.285296 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e41397d8-a189-42c8-9282-e22ecb726c07 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:38.286032 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e41397d8-a189-42c8-9282-e22ecb726c07 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:38.292297 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e41397d8-a189-42c8-9282-e22ecb726c07 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:38.292740 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e41397d8-a189-42c8-9282-e22ecb726c07 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:38.293508 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e41397d8-a189-42c8-9282-e22ecb726c07 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:38.293969 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e41397d8-a189-42c8-9282-e22ecb726c07 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:38.430261 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e41397d8-a189-42c8-9282-e22ecb726c07 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:38.438174 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e41397d8-a189-42c8-9282-e22ecb726c07 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1564 microversion: 2.1 time: 0.157569 May 16 19:11:38.438756 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 269/553] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:38 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:38.454817 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ffb4d38c-acb3-4346-89e3-9dfb7f07fd91 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:38.455307 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ffb4d38c-acb3-4346-89e3-9dfb7f07fd91 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:38.461701 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ffb4d38c-acb3-4346-89e3-9dfb7f07fd91 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:38.462093 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ffb4d38c-acb3-4346-89e3-9dfb7f07fd91 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:38.462875 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ffb4d38c-acb3-4346-89e3-9dfb7f07fd91 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:38.463326 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ffb4d38c-acb3-4346-89e3-9dfb7f07fd91 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:38.552192 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ffb4d38c-acb3-4346-89e3-9dfb7f07fd91 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100899 May 16 19:11:38.553011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 285/554] 10.222.0.24 () {58 vars in 1274 bytes} [Mon May 16 19:11:38 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:11:38.981218 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-cc1804a9-6fed-414b-aa99-31500db78375 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:38.981908 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-cc1804a9-6fed-414b-aa99-31500db78375 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:38.988327 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cc1804a9-6fed-414b-aa99-31500db78375 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:38.988778 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cc1804a9-6fed-414b-aa99-31500db78375 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:38.989550 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cc1804a9-6fed-414b-aa99-31500db78375 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:38.989995 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cc1804a9-6fed-414b-aa99-31500db78375 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:39.130726 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-cc1804a9-6fed-414b-aa99-31500db78375 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:39.138526 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-cc1804a9-6fed-414b-aa99-31500db78375 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.161848 May 16 19:11:39.146248 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 270/555] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:38 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:39.242333 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a27bda67-2bbc-41a2-a8a3-7abf25829afa tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:39.242935 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a27bda67-2bbc-41a2-a8a3-7abf25829afa tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:39.250044 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a27bda67-2bbc-41a2-a8a3-7abf25829afa tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:39.250487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a27bda67-2bbc-41a2-a8a3-7abf25829afa tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:39.251253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a27bda67-2bbc-41a2-a8a3-7abf25829afa tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:39.251675 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a27bda67-2bbc-41a2-a8a3-7abf25829afa tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:39.456821 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a27bda67-2bbc-41a2-a8a3-7abf25829afa tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:39.465889 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a27bda67-2bbc-41a2-a8a3-7abf25829afa tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:39.467370 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a27bda67-2bbc-41a2-a8a3-7abf25829afa tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:39.468586 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a27bda67-2bbc-41a2-a8a3-7abf25829afa tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.230271 May 16 19:11:39.469322 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 286/556] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:39 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:39.598701 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-4779b72c-a077-4ff2-8fa0-24e3b2956422 req-208ea60c-e7f0-419a-b351-f7aaac5cbd60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb4d6c5-966a-44b0-a092-602b55ec665c", "tag": "2f53d2f3-16ec-408d-b308-a79d7b29c2e9"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:39.607847 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-4779b72c-a077-4ff2-8fa0-24e3b2956422 req-208ea60c-e7f0-419a-b351-f7aaac5cbd60 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:39.608346 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-4779b72c-a077-4ff2-8fa0-24e3b2956422 req-208ea60c-e7f0-419a-b351-f7aaac5cbd60 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:39.619776 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-4779b72c-a077-4ff2-8fa0-24e3b2956422 req-208ea60c-e7f0-419a-b351-f7aaac5cbd60 service nova] Creating event network-changed:2f53d2f3-16ec-408d-b308-a79d7b29c2e9 for instance eeb4d6c5-966a-44b0-a092-602b55ec665c on hv-cinder-76606 May 16 19:11:39.625005 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-4779b72c-a077-4ff2-8fa0-24e3b2956422 req-208ea60c-e7f0-419a-b351-f7aaac5cbd60 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030046 May 16 19:11:39.625698 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 271/557] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:11:39.814833 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-80afe0e8-5a5c-4618-97d3-1471a5e96abb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:39.815524 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-80afe0e8-5a5c-4618-97d3-1471a5e96abb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:39.822180 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-80afe0e8-5a5c-4618-97d3-1471a5e96abb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:39.822624 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-80afe0e8-5a5c-4618-97d3-1471a5e96abb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:39.823429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-80afe0e8-5a5c-4618-97d3-1471a5e96abb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:39.823973 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-80afe0e8-5a5c-4618-97d3-1471a5e96abb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:39.953131 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-80afe0e8-5a5c-4618-97d3-1471a5e96abb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lazy-loading 'services' on Instance uuid a68fcd6b-1593-4fd4-8915-3153f52105c1 {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:11:40.067216 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-80afe0e8-5a5c-4618-97d3-1471a5e96abb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/os-volume_attachments/b9421465-95c1-4125-a75a-c8ab114db038" status: 202 len: 0 microversion: 2.1 time: 0.256202 May 16 19:11:40.067835 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 287/558] 10.222.0.24 () {58 vars in 1415 bytes} [Mon May 16 19:11:39 2022] DELETE /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/os-volume_attachments/b9421465-95c1-4125-a75a-c8ab114db038 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:11:40.157071 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8ba2a662-7cc9-4575-b029-be728378b282 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:40.158057 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8ba2a662-7cc9-4575-b029-be728378b282 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:40.165782 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8ba2a662-7cc9-4575-b029-be728378b282 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:40.165782 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8ba2a662-7cc9-4575-b029-be728378b282 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:40.166567 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8ba2a662-7cc9-4575-b029-be728378b282 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:40.167005 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8ba2a662-7cc9-4575-b029-be728378b282 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:40.304263 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8ba2a662-7cc9-4575-b029-be728378b282 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:40.313385 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8ba2a662-7cc9-4575-b029-be728378b282 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.160250 May 16 19:11:40.314262 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 272/559] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:40 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:40.489089 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c22fd633-7522-4212-8740-dbef4ec54bec tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:40.489833 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c22fd633-7522-4212-8740-dbef4ec54bec tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:40.497800 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c22fd633-7522-4212-8740-dbef4ec54bec tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:40.498258 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c22fd633-7522-4212-8740-dbef4ec54bec tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:40.499053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c22fd633-7522-4212-8740-dbef4ec54bec tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:40.499490 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c22fd633-7522-4212-8740-dbef4ec54bec tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:40.634008 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c22fd633-7522-4212-8740-dbef4ec54bec tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:40.642794 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c22fd633-7522-4212-8740-dbef4ec54bec tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:40.644599 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c22fd633-7522-4212-8740-dbef4ec54bec tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:40.645895 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c22fd633-7522-4212-8740-dbef4ec54bec tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.161963 May 16 19:11:40.646472 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 288/560] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:40 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:41.335235 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-97ec78dc-530d-4630-a1f9-fb4cc0ee862a tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:41.336250 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-97ec78dc-530d-4630-a1f9-fb4cc0ee862a tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:41.352893 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-97ec78dc-530d-4630-a1f9-fb4cc0ee862a tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:41.353718 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-97ec78dc-530d-4630-a1f9-fb4cc0ee862a tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:41.354712 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-97ec78dc-530d-4630-a1f9-fb4cc0ee862a tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:41.355147 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-97ec78dc-530d-4630-a1f9-fb4cc0ee862a tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:41.485637 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-97ec78dc-530d-4630-a1f9-fb4cc0ee862a tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:41.493620 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-97ec78dc-530d-4630-a1f9-fb4cc0ee862a tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.165187 May 16 19:11:41.494201 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 273/561] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:41 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:41.669196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-6b031e69-65e2-48ad-bedf-c6c03e8e145a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:41.669866 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-6b031e69-65e2-48ad-bedf-c6c03e8e145a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:41.681263 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6b031e69-65e2-48ad-bedf-c6c03e8e145a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:41.682206 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6b031e69-65e2-48ad-bedf-c6c03e8e145a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:41.683511 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6b031e69-65e2-48ad-bedf-c6c03e8e145a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:41.684287 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6b031e69-65e2-48ad-bedf-c6c03e8e145a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:41.823885 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-6b031e69-65e2-48ad-bedf-c6c03e8e145a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:41.832702 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-6b031e69-65e2-48ad-bedf-c6c03e8e145a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:41.834383 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-6b031e69-65e2-48ad-bedf-c6c03e8e145a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:41.835612 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-6b031e69-65e2-48ad-bedf-c6c03e8e145a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.173851 May 16 19:11:41.836144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 289/562] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:41 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:42.518723 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c33d6319-7e3b-44e8-80ae-069052aa6d03 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:42.519716 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c33d6319-7e3b-44e8-80ae-069052aa6d03 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:42.527656 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c33d6319-7e3b-44e8-80ae-069052aa6d03 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:42.528105 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c33d6319-7e3b-44e8-80ae-069052aa6d03 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:42.528860 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c33d6319-7e3b-44e8-80ae-069052aa6d03 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:42.529283 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c33d6319-7e3b-44e8-80ae-069052aa6d03 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:42.663453 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c33d6319-7e3b-44e8-80ae-069052aa6d03 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:42.671332 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c33d6319-7e3b-44e8-80ae-069052aa6d03 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.159001 May 16 19:11:42.671801 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 274/563] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:42 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:42.854238 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b71a1e42-ee8c-496a-b90d-3fba19a1b7f3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:42.854848 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b71a1e42-ee8c-496a-b90d-3fba19a1b7f3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:42.861511 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b71a1e42-ee8c-496a-b90d-3fba19a1b7f3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:42.862002 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b71a1e42-ee8c-496a-b90d-3fba19a1b7f3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:42.862777 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b71a1e42-ee8c-496a-b90d-3fba19a1b7f3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:42.863207 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b71a1e42-ee8c-496a-b90d-3fba19a1b7f3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:42.997872 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b71a1e42-ee8c-496a-b90d-3fba19a1b7f3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:43.006466 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b71a1e42-ee8c-496a-b90d-3fba19a1b7f3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:43.007936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b71a1e42-ee8c-496a-b90d-3fba19a1b7f3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:43.009086 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b71a1e42-ee8c-496a-b90d-3fba19a1b7f3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.158889 May 16 19:11:43.009713 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 290/564] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:42 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:43.692896 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-bf90b845-29ff-4ba1-92fc-e82631abef13 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:43.693792 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-bf90b845-29ff-4ba1-92fc-e82631abef13 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:43.701259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bf90b845-29ff-4ba1-92fc-e82631abef13 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:43.701907 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bf90b845-29ff-4ba1-92fc-e82631abef13 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:43.702715 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bf90b845-29ff-4ba1-92fc-e82631abef13 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:43.703173 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bf90b845-29ff-4ba1-92fc-e82631abef13 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:43.835042 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-bf90b845-29ff-4ba1-92fc-e82631abef13 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:43.845479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-bf90b845-29ff-4ba1-92fc-e82631abef13 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.159246 May 16 19:11:43.846345 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 275/565] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:43 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:44.032429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a05df541-0d7a-4800-bacc-858a90dfd77b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:44.033282 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a05df541-0d7a-4800-bacc-858a90dfd77b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:44.044139 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a05df541-0d7a-4800-bacc-858a90dfd77b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:44.044887 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a05df541-0d7a-4800-bacc-858a90dfd77b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:44.046271 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a05df541-0d7a-4800-bacc-858a90dfd77b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:44.046988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a05df541-0d7a-4800-bacc-858a90dfd77b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:44.179998 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a05df541-0d7a-4800-bacc-858a90dfd77b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:44.188454 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a05df541-0d7a-4800-bacc-858a90dfd77b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:44.189975 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a05df541-0d7a-4800-bacc-858a90dfd77b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:44.191141 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a05df541-0d7a-4800-bacc-858a90dfd77b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.165517 May 16 19:11:44.191700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 291/566] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:44 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:44.864011 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d5cc63dc-8ff8-4860-8bfe-ef62858ba265 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:44.864580 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d5cc63dc-8ff8-4860-8bfe-ef62858ba265 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:44.871441 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d5cc63dc-8ff8-4860-8bfe-ef62858ba265 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:44.871884 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d5cc63dc-8ff8-4860-8bfe-ef62858ba265 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:44.872649 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d5cc63dc-8ff8-4860-8bfe-ef62858ba265 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:44.873081 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d5cc63dc-8ff8-4860-8bfe-ef62858ba265 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:44.923996 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-2cf5bb9e-c0b3-4990-a09d-60b35cbc5fe3 req-d74f3321-b3a9-445e-ac7a-aa8276914279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b53695-b6e7-4e7b-b6d5-539770d20f41", "name": "network-vif-plugged", "status": "completed", "tag": "5ed69d31-3be1-4fa7-a495-fce15a7677cb"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:44.932890 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-2cf5bb9e-c0b3-4990-a09d-60b35cbc5fe3 req-d74f3321-b3a9-445e-ac7a-aa8276914279 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:44.933285 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-2cf5bb9e-c0b3-4990-a09d-60b35cbc5fe3 req-d74f3321-b3a9-445e-ac7a-aa8276914279 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:44.945271 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-2cf5bb9e-c0b3-4990-a09d-60b35cbc5fe3 req-d74f3321-b3a9-445e-ac7a-aa8276914279 service nova] Creating event network-vif-plugged:5ed69d31-3be1-4fa7-a495-fce15a7677cb for instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 on hv-cinder-76606 May 16 19:11:44.951098 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-2cf5bb9e-c0b3-4990-a09d-60b35cbc5fe3 req-d74f3321-b3a9-445e-ac7a-aa8276914279 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030827 May 16 19:11:44.952261 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 292/567] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:11:45.026939 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d5cc63dc-8ff8-4860-8bfe-ef62858ba265 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:45.034609 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d5cc63dc-8ff8-4860-8bfe-ef62858ba265 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.174544 May 16 19:11:45.035182 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 276/568] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:44 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:45.211251 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-05ce3cf6-24a5-43b4-8b2d-8c1836b5a675 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:45.211952 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-05ce3cf6-24a5-43b4-8b2d-8c1836b5a675 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:45.219836 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-05ce3cf6-24a5-43b4-8b2d-8c1836b5a675 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:45.220272 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-05ce3cf6-24a5-43b4-8b2d-8c1836b5a675 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:45.221036 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-05ce3cf6-24a5-43b4-8b2d-8c1836b5a675 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:45.221463 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-05ce3cf6-24a5-43b4-8b2d-8c1836b5a675 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:45.354614 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-05ce3cf6-24a5-43b4-8b2d-8c1836b5a675 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:45.363442 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-05ce3cf6-24a5-43b4-8b2d-8c1836b5a675 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:45.364963 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-05ce3cf6-24a5-43b4-8b2d-8c1836b5a675 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:45.366184 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-05ce3cf6-24a5-43b4-8b2d-8c1836b5a675 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.159828 May 16 19:11:45.366795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 293/569] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:45 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:46.051756 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-a3afedeb-d12b-45b0-8fe2-7677865e8e84 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:46.052366 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-a3afedeb-d12b-45b0-8fe2-7677865e8e84 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:46.059219 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a3afedeb-d12b-45b0-8fe2-7677865e8e84 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:46.059847 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a3afedeb-d12b-45b0-8fe2-7677865e8e84 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:46.060608 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a3afedeb-d12b-45b0-8fe2-7677865e8e84 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:46.061046 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a3afedeb-d12b-45b0-8fe2-7677865e8e84 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:46.220908 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-a3afedeb-d12b-45b0-8fe2-7677865e8e84 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:46.228800 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-a3afedeb-d12b-45b0-8fe2-7677865e8e84 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.180996 May 16 19:11:46.229424 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 277/570] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:46 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:46.388037 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2c393615-efd9-4556-b808-67caf2e09025 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:46.388681 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2c393615-efd9-4556-b808-67caf2e09025 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:46.396933 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c393615-efd9-4556-b808-67caf2e09025 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:46.397488 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c393615-efd9-4556-b808-67caf2e09025 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:46.398491 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c393615-efd9-4556-b808-67caf2e09025 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:46.399403 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c393615-efd9-4556-b808-67caf2e09025 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:46.533572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2c393615-efd9-4556-b808-67caf2e09025 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:46.546081 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2c393615-efd9-4556-b808-67caf2e09025 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:46.548422 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2c393615-efd9-4556-b808-67caf2e09025 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:46.550275 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2c393615-efd9-4556-b808-67caf2e09025 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.168138 May 16 19:11:46.551109 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 294/571] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:46 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:47.248422 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e7454fa2-e073-46db-8421-c2edc038db86 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:47.249134 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e7454fa2-e073-46db-8421-c2edc038db86 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:47.257141 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e7454fa2-e073-46db-8421-c2edc038db86 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:47.257737 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e7454fa2-e073-46db-8421-c2edc038db86 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:47.258635 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e7454fa2-e073-46db-8421-c2edc038db86 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:47.259113 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e7454fa2-e073-46db-8421-c2edc038db86 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:47.400460 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e7454fa2-e073-46db-8421-c2edc038db86 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:47.408011 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e7454fa2-e073-46db-8421-c2edc038db86 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.164783 May 16 19:11:47.408583 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 278/572] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:47 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:47.571060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0c03035d-33fe-4f85-a50c-6209aa096139 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:47.571671 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0c03035d-33fe-4f85-a50c-6209aa096139 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:47.578618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0c03035d-33fe-4f85-a50c-6209aa096139 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:47.579065 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0c03035d-33fe-4f85-a50c-6209aa096139 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:47.579832 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0c03035d-33fe-4f85-a50c-6209aa096139 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:47.580263 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0c03035d-33fe-4f85-a50c-6209aa096139 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:47.715213 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0c03035d-33fe-4f85-a50c-6209aa096139 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:47.723864 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0c03035d-33fe-4f85-a50c-6209aa096139 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:47.725330 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0c03035d-33fe-4f85-a50c-6209aa096139 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:47.726509 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0c03035d-33fe-4f85-a50c-6209aa096139 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.159379 May 16 19:11:47.727067 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 295/573] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:47 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:48.429735 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c78b4f62-9ed0-46c9-9cf7-9f1e2d6f2778 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:48.430794 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c78b4f62-9ed0-46c9-9cf7-9f1e2d6f2778 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:48.441742 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c78b4f62-9ed0-46c9-9cf7-9f1e2d6f2778 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:48.442478 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c78b4f62-9ed0-46c9-9cf7-9f1e2d6f2778 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:48.443742 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c78b4f62-9ed0-46c9-9cf7-9f1e2d6f2778 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:48.444463 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c78b4f62-9ed0-46c9-9cf7-9f1e2d6f2778 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:48.578929 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c78b4f62-9ed0-46c9-9cf7-9f1e2d6f2778 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:48.586411 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c78b4f62-9ed0-46c9-9cf7-9f1e2d6f2778 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.163454 May 16 19:11:48.586970 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 279/574] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:48 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:48.748745 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7ea60de9-c7a2-46ae-a42b-f89827cad93c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:48.749295 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7ea60de9-c7a2-46ae-a42b-f89827cad93c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:48.756098 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7ea60de9-c7a2-46ae-a42b-f89827cad93c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:48.756554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7ea60de9-c7a2-46ae-a42b-f89827cad93c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:48.757335 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7ea60de9-c7a2-46ae-a42b-f89827cad93c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:48.757799 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7ea60de9-c7a2-46ae-a42b-f89827cad93c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:48.895420 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7ea60de9-c7a2-46ae-a42b-f89827cad93c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:48.904309 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7ea60de9-c7a2-46ae-a42b-f89827cad93c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:48.905831 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7ea60de9-c7a2-46ae-a42b-f89827cad93c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:48.907005 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7ea60de9-c7a2-46ae-a42b-f89827cad93c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.164237 May 16 19:11:48.907570 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 296/575] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:48 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:49.603094 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3bbc308a-b0b8-4b31-8059-c81133e2de62 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:49.603705 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-3bbc308a-b0b8-4b31-8059-c81133e2de62 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:49.611219 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3bbc308a-b0b8-4b31-8059-c81133e2de62 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:49.611673 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3bbc308a-b0b8-4b31-8059-c81133e2de62 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:49.612750 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3bbc308a-b0b8-4b31-8059-c81133e2de62 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:49.613556 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3bbc308a-b0b8-4b31-8059-c81133e2de62 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:49.757669 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-3bbc308a-b0b8-4b31-8059-c81133e2de62 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:49.766559 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-3bbc308a-b0b8-4b31-8059-c81133e2de62 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.167314 May 16 19:11:49.767133 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 280/576] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:49 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:49.929463 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e2578e04-a70d-495a-9cb7-bdf69d133f26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:49.930493 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e2578e04-a70d-495a-9cb7-bdf69d133f26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:49.941903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e2578e04-a70d-495a-9cb7-bdf69d133f26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:49.942639 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e2578e04-a70d-495a-9cb7-bdf69d133f26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:49.943893 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e2578e04-a70d-495a-9cb7-bdf69d133f26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:49.944601 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e2578e04-a70d-495a-9cb7-bdf69d133f26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:50.083980 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e2578e04-a70d-495a-9cb7-bdf69d133f26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:50.092688 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e2578e04-a70d-495a-9cb7-bdf69d133f26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:50.094231 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e2578e04-a70d-495a-9cb7-bdf69d133f26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:50.095409 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e2578e04-a70d-495a-9cb7-bdf69d133f26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.172395 May 16 19:11:50.095978 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 297/577] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:49 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:50.704537 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b8a7aee7-6dcb-44fb-90c9-5a52f430f98f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:50.711144 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b8a7aee7-6dcb-44fb-90c9-5a52f430f98f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:50.711574 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b8a7aee7-6dcb-44fb-90c9-5a52f430f98f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:50.771395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b8a7aee7-6dcb-44fb-90c9-5a52f430f98f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Going to try to stop instance {{(pid=117275) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 19:11:50.788389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9a430dc3-f6ed-4135-b344-8ebaf77208b3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:50.789005 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9a430dc3-f6ed-4135-b344-8ebaf77208b3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:50.795342 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9a430dc3-f6ed-4135-b344-8ebaf77208b3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:50.795797 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9a430dc3-f6ed-4135-b344-8ebaf77208b3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:50.796570 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9a430dc3-f6ed-4135-b344-8ebaf77208b3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:50.796968 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9a430dc3-f6ed-4135-b344-8ebaf77208b3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:50.819422 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b8a7aee7-6dcb-44fb-90c9-5a52f430f98f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "POST /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/action" status: 202 len: 0 microversion: 2.1 time: 0.118641 May 16 19:11:50.820032 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 281/578] 10.222.0.24 () {60 vars in 1277 bytes} [Mon May 16 19:11:50 2022] POST /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:11:50.828399 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-cfbe5c0f-7090-4ec8-a49b-1ae38cf397f1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:50.829096 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-cfbe5c0f-7090-4ec8-a49b-1ae38cf397f1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:50.835370 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cfbe5c0f-7090-4ec8-a49b-1ae38cf397f1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:50.835849 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cfbe5c0f-7090-4ec8-a49b-1ae38cf397f1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:50.836605 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cfbe5c0f-7090-4ec8-a49b-1ae38cf397f1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:50.837033 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cfbe5c0f-7090-4ec8-a49b-1ae38cf397f1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:50.930126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9a430dc3-f6ed-4135-b344-8ebaf77208b3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:50.938239 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9a430dc3-f6ed-4135-b344-8ebaf77208b3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.153656 May 16 19:11:50.939002 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 298/579] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:50 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:50.967113 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-cfbe5c0f-7090-4ec8-a49b-1ae38cf397f1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:50.974695 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-cfbe5c0f-7090-4ec8-a49b-1ae38cf397f1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1676 microversion: 2.1 time: 0.150201 May 16 19:11:50.975273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 282/580] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:50 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:51.113407 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-3b115758-4b07-4a8b-9344-e45ca0e18abb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:51.114028 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-3b115758-4b07-4a8b-9344-e45ca0e18abb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:51.120227 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3b115758-4b07-4a8b-9344-e45ca0e18abb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:51.120656 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3b115758-4b07-4a8b-9344-e45ca0e18abb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:51.121660 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3b115758-4b07-4a8b-9344-e45ca0e18abb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:51.122090 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3b115758-4b07-4a8b-9344-e45ca0e18abb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:51.262755 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-3b115758-4b07-4a8b-9344-e45ca0e18abb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:51.271640 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-3b115758-4b07-4a8b-9344-e45ca0e18abb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:51.273127 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-3b115758-4b07-4a8b-9344-e45ca0e18abb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:51.274742 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-3b115758-4b07-4a8b-9344-e45ca0e18abb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.165238 May 16 19:11:51.275278 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 299/581] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:51 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:51.959187 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e3bf49b5-e1f5-479e-946d-ad678a672721 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:51.960022 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e3bf49b5-e1f5-479e-946d-ad678a672721 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:51.970852 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e3bf49b5-e1f5-479e-946d-ad678a672721 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:51.971578 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e3bf49b5-e1f5-479e-946d-ad678a672721 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:51.972826 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e3bf49b5-e1f5-479e-946d-ad678a672721 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:51.973600 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e3bf49b5-e1f5-479e-946d-ad678a672721 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:51.991898 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-dab7c36d-7f9f-42ea-bea7-f08d067b855a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:51.992516 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-dab7c36d-7f9f-42ea-bea7-f08d067b855a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:51.999004 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dab7c36d-7f9f-42ea-bea7-f08d067b855a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:51.999484 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dab7c36d-7f9f-42ea-bea7-f08d067b855a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:52.000254 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dab7c36d-7f9f-42ea-bea7-f08d067b855a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:52.000681 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dab7c36d-7f9f-42ea-bea7-f08d067b855a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:52.112023 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e3bf49b5-e1f5-479e-946d-ad678a672721 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:52.119515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e3bf49b5-e1f5-479e-946d-ad678a672721 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.167044 May 16 19:11:52.120422 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 283/582] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:51 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:52.130014 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-dab7c36d-7f9f-42ea-bea7-f08d067b855a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:52.137724 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-dab7c36d-7f9f-42ea-bea7-f08d067b855a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1676 microversion: 2.1 time: 0.149700 May 16 19:11:52.138338 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 300/583] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:51 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:52.295872 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b853eaca-d60e-4b90-8e0c-3bfe8d2cc6e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:52.296696 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b853eaca-d60e-4b90-8e0c-3bfe8d2cc6e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:52.305248 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b853eaca-d60e-4b90-8e0c-3bfe8d2cc6e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:52.305897 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b853eaca-d60e-4b90-8e0c-3bfe8d2cc6e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:52.306931 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b853eaca-d60e-4b90-8e0c-3bfe8d2cc6e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:52.307512 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b853eaca-d60e-4b90-8e0c-3bfe8d2cc6e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:52.436670 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b853eaca-d60e-4b90-8e0c-3bfe8d2cc6e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:52.445682 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b853eaca-d60e-4b90-8e0c-3bfe8d2cc6e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:52.447186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b853eaca-d60e-4b90-8e0c-3bfe8d2cc6e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:52.448351 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b853eaca-d60e-4b90-8e0c-3bfe8d2cc6e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.158198 May 16 19:11:52.448931 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 284/584] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:52 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:53.139704 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-67fcf8df-8153-416d-bbb8-bdcf92cca3e0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:53.140297 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-67fcf8df-8153-416d-bbb8-bdcf92cca3e0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:53.147137 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-67fcf8df-8153-416d-bbb8-bdcf92cca3e0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:53.147576 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-67fcf8df-8153-416d-bbb8-bdcf92cca3e0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:53.148331 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-67fcf8df-8153-416d-bbb8-bdcf92cca3e0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:53.149123 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-67fcf8df-8153-416d-bbb8-bdcf92cca3e0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:53.154711 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-de8f00e9-91b5-4f62-a2cf-a848da358e31 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:53.155325 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-de8f00e9-91b5-4f62-a2cf-a848da358e31 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:53.162106 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-de8f00e9-91b5-4f62-a2cf-a848da358e31 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:53.162556 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-de8f00e9-91b5-4f62-a2cf-a848da358e31 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:53.163336 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-de8f00e9-91b5-4f62-a2cf-a848da358e31 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:53.163734 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-de8f00e9-91b5-4f62-a2cf-a848da358e31 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:53.287587 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-67fcf8df-8153-416d-bbb8-bdcf92cca3e0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:53.295379 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-67fcf8df-8153-416d-bbb8-bdcf92cca3e0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.161146 May 16 19:11:53.295905 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-de8f00e9-91b5-4f62-a2cf-a848da358e31 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:53.296080 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 301/585] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:53 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:53.303365 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-de8f00e9-91b5-4f62-a2cf-a848da358e31 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1676 microversion: 2.1 time: 0.152569 May 16 19:11:53.303933 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 285/586] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:53 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:53.479534 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-60e6bebb-5a1a-41f7-a80b-8371b148bf1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:53.480555 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-60e6bebb-5a1a-41f7-a80b-8371b148bf1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:53.487875 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-60e6bebb-5a1a-41f7-a80b-8371b148bf1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:53.488361 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-60e6bebb-5a1a-41f7-a80b-8371b148bf1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:53.489139 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-60e6bebb-5a1a-41f7-a80b-8371b148bf1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:53.489562 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-60e6bebb-5a1a-41f7-a80b-8371b148bf1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:53.621675 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-60e6bebb-5a1a-41f7-a80b-8371b148bf1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:53.630195 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-60e6bebb-5a1a-41f7-a80b-8371b148bf1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:53.631681 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-60e6bebb-5a1a-41f7-a80b-8371b148bf1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:53.632852 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-60e6bebb-5a1a-41f7-a80b-8371b148bf1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.159868 May 16 19:11:53.633417 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 302/587] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:53 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:54.314495 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8de89e1b-7e66-4e25-856c-d7caa6a96ff4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:54.315001 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8de89e1b-7e66-4e25-856c-d7caa6a96ff4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:54.320309 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-92156519-ea8f-4603-b425-35c875d2b10a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:54.320939 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-92156519-ea8f-4603-b425-35c875d2b10a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:54.322075 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8de89e1b-7e66-4e25-856c-d7caa6a96ff4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:54.322528 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8de89e1b-7e66-4e25-856c-d7caa6a96ff4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:54.323311 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8de89e1b-7e66-4e25-856c-d7caa6a96ff4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:54.323742 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8de89e1b-7e66-4e25-856c-d7caa6a96ff4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:54.327827 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-92156519-ea8f-4603-b425-35c875d2b10a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:54.328310 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-92156519-ea8f-4603-b425-35c875d2b10a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:54.329064 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-92156519-ea8f-4603-b425-35c875d2b10a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:54.329517 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-92156519-ea8f-4603-b425-35c875d2b10a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:54.454659 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-92156519-ea8f-4603-b425-35c875d2b10a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:54.456245 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8de89e1b-7e66-4e25-856c-d7caa6a96ff4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:54.462360 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-92156519-ea8f-4603-b425-35c875d2b10a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1676 microversion: 2.1 time: 0.145793 May 16 19:11:54.462944 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 303/588] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:54 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:54.463528 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8de89e1b-7e66-4e25-856c-d7caa6a96ff4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.153855 May 16 19:11:54.464073 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 286/589] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:54 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:54.467609 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-04c5b664-e612-4401-b9b8-dd6674b4043d tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:54.468633 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-04c5b664-e612-4401-b9b8-dd6674b4043d tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:54.474492 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-04c5b664-e612-4401-b9b8-dd6674b4043d tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:54.474945 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-04c5b664-e612-4401-b9b8-dd6674b4043d tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:54.475712 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-04c5b664-e612-4401-b9b8-dd6674b4043d tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:54.476151 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-04c5b664-e612-4401-b9b8-dd6674b4043d tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:54.548956 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-04c5b664-e612-4401-b9b8-dd6674b4043d tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "POST /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/action" status: 202 len: 0 microversion: 2.1 time: 0.084759 May 16 19:11:54.549654 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 304/590] 10.222.0.24 () {60 vars in 1277 bytes} [Mon May 16 19:11:54 2022] POST /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:11:54.558526 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c040cc7c-a686-4f4e-8dc4-ed9ae972ec7e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:54.559485 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c040cc7c-a686-4f4e-8dc4-ed9ae972ec7e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:54.565296 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c040cc7c-a686-4f4e-8dc4-ed9ae972ec7e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:54.565775 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c040cc7c-a686-4f4e-8dc4-ed9ae972ec7e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:54.566565 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c040cc7c-a686-4f4e-8dc4-ed9ae972ec7e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:54.566997 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c040cc7c-a686-4f4e-8dc4-ed9ae972ec7e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:54.651477 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-280fb247-2a83-4d54-ae9f-d0a98bf91a88 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:54.652181 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-280fb247-2a83-4d54-ae9f-d0a98bf91a88 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:54.658640 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-280fb247-2a83-4d54-ae9f-d0a98bf91a88 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:54.659087 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-280fb247-2a83-4d54-ae9f-d0a98bf91a88 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:54.659871 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-280fb247-2a83-4d54-ae9f-d0a98bf91a88 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:54.660301 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-280fb247-2a83-4d54-ae9f-d0a98bf91a88 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:54.718053 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c040cc7c-a686-4f4e-8dc4-ed9ae972ec7e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:54.727031 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c040cc7c-a686-4f4e-8dc4-ed9ae972ec7e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1751 microversion: 2.1 time: 0.173140 May 16 19:11:54.727941 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 287/591] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:54 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:54.740454 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-32f63180-413d-4c5b-b033-b0abe5e0a750 req-066761e6-7ec5-402f-b616-62b181d36879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a385b0-58f3-4946-b6c6-2cbd20fe387f", "name": "network-vif-plugged", "status": "completed", "tag": "aadd3356-5374-4e27-aec5-d1a129d4438b"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:11:54.749989 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-32f63180-413d-4c5b-b033-b0abe5e0a750 req-066761e6-7ec5-402f-b616-62b181d36879 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:54.750441 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-32f63180-413d-4c5b-b033-b0abe5e0a750 req-066761e6-7ec5-402f-b616-62b181d36879 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:54.761863 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-32f63180-413d-4c5b-b033-b0abe5e0a750 req-066761e6-7ec5-402f-b616-62b181d36879 service nova] Creating event network-vif-plugged:aadd3356-5374-4e27-aec5-d1a129d4438b for instance 96a385b0-58f3-4946-b6c6-2cbd20fe387f on hv-cinder-76606 May 16 19:11:54.767659 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-32f63180-413d-4c5b-b033-b0abe5e0a750 req-066761e6-7ec5-402f-b616-62b181d36879 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038319 May 16 19:11:54.768276 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 288/592] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:11:54.799934 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-280fb247-2a83-4d54-ae9f-d0a98bf91a88 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:54.808299 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-280fb247-2a83-4d54-ae9f-d0a98bf91a88 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:54.809798 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-280fb247-2a83-4d54-ae9f-d0a98bf91a88 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:54.810959 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-280fb247-2a83-4d54-ae9f-d0a98bf91a88 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1809 microversion: 2.20 time: 0.164211 May 16 19:11:54.811554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 305/593] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:54 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:11:55.480037 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-163abceb-9742-42ef-b949-fb5538ce1611 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:55.481437 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-163abceb-9742-42ef-b949-fb5538ce1611 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:55.481548 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-42eb95d7-29fa-4d45-aab2-60a67b377d2f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:55.482252 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-42eb95d7-29fa-4d45-aab2-60a67b377d2f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:55.488175 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-163abceb-9742-42ef-b949-fb5538ce1611 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:55.488631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-163abceb-9742-42ef-b949-fb5538ce1611 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:55.489415 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-163abceb-9742-42ef-b949-fb5538ce1611 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:55.489874 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-163abceb-9742-42ef-b949-fb5538ce1611 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:55.490244 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-42eb95d7-29fa-4d45-aab2-60a67b377d2f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:55.490885 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-42eb95d7-29fa-4d45-aab2-60a67b377d2f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:55.491875 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-42eb95d7-29fa-4d45-aab2-60a67b377d2f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:55.492532 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-42eb95d7-29fa-4d45-aab2-60a67b377d2f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:55.631121 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-163abceb-9742-42ef-b949-fb5538ce1611 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:55.639093 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-163abceb-9742-42ef-b949-fb5538ce1611 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.162895 May 16 19:11:55.639755 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 306/594] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:55 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:55.665856 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-42eb95d7-29fa-4d45-aab2-60a67b377d2f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:55.673739 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-42eb95d7-29fa-4d45-aab2-60a67b377d2f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1676 microversion: 2.1 time: 0.197380 May 16 19:11:55.674245 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 289/595] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:55 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1676 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:55.748621 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0e06027f-5ad3-4320-a0cf-251724dd7572 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:55.749385 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0e06027f-5ad3-4320-a0cf-251724dd7572 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:55.755806 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0e06027f-5ad3-4320-a0cf-251724dd7572 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:55.756242 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0e06027f-5ad3-4320-a0cf-251724dd7572 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:55.757026 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0e06027f-5ad3-4320-a0cf-251724dd7572 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:55.757490 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0e06027f-5ad3-4320-a0cf-251724dd7572 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:55.828954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-18123422-6c22-4813-b5f1-6f171b4f25a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:55.829908 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-18123422-6c22-4813-b5f1-6f171b4f25a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:55.838845 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-18123422-6c22-4813-b5f1-6f171b4f25a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:55.839362 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-18123422-6c22-4813-b5f1-6f171b4f25a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:55.840186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-18123422-6c22-4813-b5f1-6f171b4f25a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:55.840710 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-18123422-6c22-4813-b5f1-6f171b4f25a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:55.905178 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0e06027f-5ad3-4320-a0cf-251724dd7572 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:55.913679 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0e06027f-5ad3-4320-a0cf-251724dd7572 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1751 microversion: 2.1 time: 0.171341 May 16 19:11:55.914230 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 307/596] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:55 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:56.033666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-18123422-6c22-4813-b5f1-6f171b4f25a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:56.042140 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-18123422-6c22-4813-b5f1-6f171b4f25a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:56.043640 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-18123422-6c22-4813-b5f1-6f171b4f25a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:56.044808 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-18123422-6c22-4813-b5f1-6f171b4f25a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1796 microversion: 2.20 time: 0.219935 May 16 19:11:56.045364 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 290/597] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:11:55 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1796 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:11:56.660672 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-3e446da8-ec1c-4ae4-8e5b-7901fc241505 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:56.661746 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-3e446da8-ec1c-4ae4-8e5b-7901fc241505 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:56.673006 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3e446da8-ec1c-4ae4-8e5b-7901fc241505 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:56.673789 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3e446da8-ec1c-4ae4-8e5b-7901fc241505 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:56.675144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3e446da8-ec1c-4ae4-8e5b-7901fc241505 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:56.675902 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3e446da8-ec1c-4ae4-8e5b-7901fc241505 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:56.692510 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d7034763-32a7-4507-843f-ce23249c56f0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:56.693228 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d7034763-32a7-4507-843f-ce23249c56f0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:56.700013 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d7034763-32a7-4507-843f-ce23249c56f0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:56.700463 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d7034763-32a7-4507-843f-ce23249c56f0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:56.701240 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d7034763-32a7-4507-843f-ce23249c56f0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:56.701705 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d7034763-32a7-4507-843f-ce23249c56f0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:56.813288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-3e446da8-ec1c-4ae4-8e5b-7901fc241505 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:56.820841 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-3e446da8-ec1c-4ae4-8e5b-7901fc241505 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.166619 May 16 19:11:56.821475 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 308/598] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:56 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:56.833206 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d7034763-32a7-4507-843f-ce23249c56f0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:56.841122 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d7034763-32a7-4507-843f-ce23249c56f0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1676 microversion: 2.1 time: 0.152563 May 16 19:11:56.841726 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 291/599] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:56 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:56.934813 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-cc593755-dad4-4fdd-8ea2-8ff1a1ca19a8 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:56.935813 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-cc593755-dad4-4fdd-8ea2-8ff1a1ca19a8 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:56.946120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cc593755-dad4-4fdd-8ea2-8ff1a1ca19a8 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:56.946861 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cc593755-dad4-4fdd-8ea2-8ff1a1ca19a8 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:56.948118 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cc593755-dad4-4fdd-8ea2-8ff1a1ca19a8 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:56.948900 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cc593755-dad4-4fdd-8ea2-8ff1a1ca19a8 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:57.099180 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-cc593755-dad4-4fdd-8ea2-8ff1a1ca19a8 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:57.111216 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-cc593755-dad4-4fdd-8ea2-8ff1a1ca19a8 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1751 microversion: 2.1 time: 0.182941 May 16 19:11:57.111788 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 309/600] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:56 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:57.841092 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b4385226-1a64-4534-9d2c-5add5d1de177 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:57.841934 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b4385226-1a64-4534-9d2c-5add5d1de177 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:57.852223 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b4385226-1a64-4534-9d2c-5add5d1de177 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:57.852912 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b4385226-1a64-4534-9d2c-5add5d1de177 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:57.854288 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b4385226-1a64-4534-9d2c-5add5d1de177 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:57.854959 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b4385226-1a64-4534-9d2c-5add5d1de177 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:57.861924 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9223f3c2-a1c1-427b-b9c0-609de5384f51 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:57.862425 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9223f3c2-a1c1-427b-b9c0-609de5384f51 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:57.868945 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9223f3c2-a1c1-427b-b9c0-609de5384f51 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:57.869395 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9223f3c2-a1c1-427b-b9c0-609de5384f51 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:57.870212 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9223f3c2-a1c1-427b-b9c0-609de5384f51 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:57.870648 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9223f3c2-a1c1-427b-b9c0-609de5384f51 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:58.000119 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b4385226-1a64-4534-9d2c-5add5d1de177 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:58.007841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b4385226-1a64-4534-9d2c-5add5d1de177 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.172936 May 16 19:11:58.008628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 292/601] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:57 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:58.022269 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9223f3c2-a1c1-427b-b9c0-609de5384f51 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:58.030116 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9223f3c2-a1c1-427b-b9c0-609de5384f51 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1676 microversion: 2.1 time: 0.174560 May 16 19:11:58.030685 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 310/602] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:57 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:58.128457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1e6225ec-25d8-4563-a442-fb8628b24e51 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:58.128969 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1e6225ec-25d8-4563-a442-fb8628b24e51 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:58.135133 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1e6225ec-25d8-4563-a442-fb8628b24e51 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:58.135571 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1e6225ec-25d8-4563-a442-fb8628b24e51 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:58.136322 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1e6225ec-25d8-4563-a442-fb8628b24e51 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:58.136746 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1e6225ec-25d8-4563-a442-fb8628b24e51 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:58.273917 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1e6225ec-25d8-4563-a442-fb8628b24e51 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:58.281821 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1e6225ec-25d8-4563-a442-fb8628b24e51 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1751 microversion: 2.1 time: 0.157384 May 16 19:11:58.282391 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 293/603] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:58 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:11:59.026625 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f7178c6c-0a7a-4429-bb36-6f6e3140211f tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:59.027296 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f7178c6c-0a7a-4429-bb36-6f6e3140211f tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:59.034855 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f7178c6c-0a7a-4429-bb36-6f6e3140211f tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:59.035317 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f7178c6c-0a7a-4429-bb36-6f6e3140211f tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:59.036094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f7178c6c-0a7a-4429-bb36-6f6e3140211f tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:59.036531 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f7178c6c-0a7a-4429-bb36-6f6e3140211f tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:59.047364 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-2c3129f9-101c-48ad-b6f4-b89862f16edb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:59.048052 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-2c3129f9-101c-48ad-b6f4-b89862f16edb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:59.054935 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2c3129f9-101c-48ad-b6f4-b89862f16edb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:59.055578 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2c3129f9-101c-48ad-b6f4-b89862f16edb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:59.056513 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2c3129f9-101c-48ad-b6f4-b89862f16edb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:59.056980 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2c3129f9-101c-48ad-b6f4-b89862f16edb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:59.171181 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f7178c6c-0a7a-4429-bb36-6f6e3140211f tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:59.178772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f7178c6c-0a7a-4429-bb36-6f6e3140211f tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.157233 May 16 19:11:59.179339 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 311/604] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:59 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:59.191532 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-2c3129f9-101c-48ad-b6f4-b89862f16edb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:59.198933 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-2c3129f9-101c-48ad-b6f4-b89862f16edb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1676 microversion: 2.1 time: 0.155666 May 16 19:11:59.199493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 294/605] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:59 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:11:59.300988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-be49d74b-d5ac-45dc-bd25-1e7910e75ce0 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:11:59.301762 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-be49d74b-d5ac-45dc-bd25-1e7910e75ce0 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:11:59.310866 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-be49d74b-d5ac-45dc-bd25-1e7910e75ce0 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:59.311506 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-be49d74b-d5ac-45dc-bd25-1e7910e75ce0 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:59.312588 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-be49d74b-d5ac-45dc-bd25-1e7910e75ce0 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:11:59.313199 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-be49d74b-d5ac-45dc-bd25-1e7910e75ce0 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:11:59.467114 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-be49d74b-d5ac-45dc-bd25-1e7910e75ce0 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:11:59.476619 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-be49d74b-d5ac-45dc-bd25-1e7910e75ce0 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1751 microversion: 2.1 time: 0.180849 May 16 19:11:59.477191 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 312/606] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:11:59 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:00.195869 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1bb7a72c-01b6-4bd2-ae73-ded354838aac tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:00.196479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1bb7a72c-01b6-4bd2-ae73-ded354838aac tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:00.203259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1bb7a72c-01b6-4bd2-ae73-ded354838aac tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:00.203714 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1bb7a72c-01b6-4bd2-ae73-ded354838aac tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:00.204469 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1bb7a72c-01b6-4bd2-ae73-ded354838aac tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:00.204898 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1bb7a72c-01b6-4bd2-ae73-ded354838aac tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:00.216142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-fb8ba71a-ee0b-4aeb-8074-330af65f6419 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:00.216753 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-fb8ba71a-ee0b-4aeb-8074-330af65f6419 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:00.223837 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb8ba71a-ee0b-4aeb-8074-330af65f6419 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:00.224289 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb8ba71a-ee0b-4aeb-8074-330af65f6419 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:00.225070 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb8ba71a-ee0b-4aeb-8074-330af65f6419 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:00.225506 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb8ba71a-ee0b-4aeb-8074-330af65f6419 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:00.338779 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1bb7a72c-01b6-4bd2-ae73-ded354838aac tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:00.346488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1bb7a72c-01b6-4bd2-ae73-ded354838aac tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.154558 May 16 19:12:00.347143 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 295/607] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:00 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:00.352835 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-fb8ba71a-ee0b-4aeb-8074-330af65f6419 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:00.360148 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-fb8ba71a-ee0b-4aeb-8074-330af65f6419 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1676 microversion: 2.1 time: 0.147981 May 16 19:12:00.360709 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 313/608] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:00 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:00.498101 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8edc5222-a1af-479b-a45c-a241384c4364 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:00.498974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8edc5222-a1af-479b-a45c-a241384c4364 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:00.505558 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8edc5222-a1af-479b-a45c-a241384c4364 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:00.506044 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8edc5222-a1af-479b-a45c-a241384c4364 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:00.506796 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8edc5222-a1af-479b-a45c-a241384c4364 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:00.507220 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8edc5222-a1af-479b-a45c-a241384c4364 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:00.656726 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8edc5222-a1af-479b-a45c-a241384c4364 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:00.665127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8edc5222-a1af-479b-a45c-a241384c4364 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1756 microversion: 2.1 time: 0.173554 May 16 19:12:00.665781 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 296/609] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:00 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:01.368195 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8c176b1d-5b60-478b-a5da-73a26ab0405c tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:01.369157 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8c176b1d-5b60-478b-a5da-73a26ab0405c tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:01.380328 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c176b1d-5b60-478b-a5da-73a26ab0405c tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:01.381080 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c176b1d-5b60-478b-a5da-73a26ab0405c tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:01.381340 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-6979ff17-66f3-4821-b641-02a3185b0ed0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:01.382388 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-6979ff17-66f3-4821-b641-02a3185b0ed0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:01.382651 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c176b1d-5b60-478b-a5da-73a26ab0405c tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:01.383112 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c176b1d-5b60-478b-a5da-73a26ab0405c tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:01.392990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6979ff17-66f3-4821-b641-02a3185b0ed0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:01.393453 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6979ff17-66f3-4821-b641-02a3185b0ed0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:01.394270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6979ff17-66f3-4821-b641-02a3185b0ed0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:01.394681 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6979ff17-66f3-4821-b641-02a3185b0ed0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:01.527223 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6979ff17-66f3-4821-b641-02a3185b0ed0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:01.533866 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-8c176b1d-5b60-478b-a5da-73a26ab0405c tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:01.535246 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-6979ff17-66f3-4821-b641-02a3185b0ed0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1676 microversion: 2.1 time: 0.160301 May 16 19:12:01.535878 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 297/610] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:01 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:01.544253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8c176b1d-5b60-478b-a5da-73a26ab0405c tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1260 microversion: 2.1 time: 0.182709 May 16 19:12:01.544949 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 314/611] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:01 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:01.685747 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5753708b-c864-4761-82dc-d86ea284dda4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:01.686769 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5753708b-c864-4761-82dc-d86ea284dda4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:01.693797 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5753708b-c864-4761-82dc-d86ea284dda4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:01.694254 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5753708b-c864-4761-82dc-d86ea284dda4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:01.695027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5753708b-c864-4761-82dc-d86ea284dda4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:01.695463 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5753708b-c864-4761-82dc-d86ea284dda4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:01.838204 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5753708b-c864-4761-82dc-d86ea284dda4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:01.846461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5753708b-c864-4761-82dc-d86ea284dda4 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1756 microversion: 2.1 time: 0.167247 May 16 19:12:01.847166 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 298/612] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:01 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:02.558731 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-67966c5e-cb3c-491d-b158-2a3e7eb8bc31 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:02.559601 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-67966c5e-cb3c-491d-b158-2a3e7eb8bc31 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:02.563723 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-13ee59e1-c68a-4f5f-8a1a-9550694a7425 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:02.564353 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-13ee59e1-c68a-4f5f-8a1a-9550694a7425 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:02.567754 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-67966c5e-cb3c-491d-b158-2a3e7eb8bc31 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:02.568202 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-67966c5e-cb3c-491d-b158-2a3e7eb8bc31 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:02.568978 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-67966c5e-cb3c-491d-b158-2a3e7eb8bc31 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:02.569411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-67966c5e-cb3c-491d-b158-2a3e7eb8bc31 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:02.570995 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-13ee59e1-c68a-4f5f-8a1a-9550694a7425 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:02.571448 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-13ee59e1-c68a-4f5f-8a1a-9550694a7425 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:02.572186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-13ee59e1-c68a-4f5f-8a1a-9550694a7425 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:02.572684 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-13ee59e1-c68a-4f5f-8a1a-9550694a7425 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:02.697361 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-67966c5e-cb3c-491d-b158-2a3e7eb8bc31 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:02.702244 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-13ee59e1-c68a-4f5f-8a1a-9550694a7425 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:02.705159 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-67966c5e-cb3c-491d-b158-2a3e7eb8bc31 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1676 microversion: 2.1 time: 0.153112 May 16 19:12:02.705779 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 315/613] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:02 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:02.711831 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-13ee59e1-c68a-4f5f-8a1a-9550694a7425 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1445 microversion: 2.1 time: 0.154350 May 16 19:12:02.712394 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 299/614] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:02 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1445 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:02.727736 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-fb15bf9b-7331-47db-87de-1a45230d74c7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:02.728344 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-fb15bf9b-7331-47db-87de-1a45230d74c7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:02.734694 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb15bf9b-7331-47db-87de-1a45230d74c7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:02.735137 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb15bf9b-7331-47db-87de-1a45230d74c7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:02.735905 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb15bf9b-7331-47db-87de-1a45230d74c7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:02.736328 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb15bf9b-7331-47db-87de-1a45230d74c7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:02.864190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-312f3e8d-4be3-472e-95c3-c1992ff5e599 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:02.864802 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-312f3e8d-4be3-472e-95c3-c1992ff5e599 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:02.868839 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-fb15bf9b-7331-47db-87de-1a45230d74c7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:02.871525 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-312f3e8d-4be3-472e-95c3-c1992ff5e599 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:02.872002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-312f3e8d-4be3-472e-95c3-c1992ff5e599 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:02.872779 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-312f3e8d-4be3-472e-95c3-c1992ff5e599 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:02.873210 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-312f3e8d-4be3-472e-95c3-c1992ff5e599 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:02.876746 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-fb15bf9b-7331-47db-87de-1a45230d74c7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1445 microversion: 2.1 time: 0.152675 May 16 19:12:02.877387 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 316/615] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:02 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:02.999233 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b1f83e58-b4a8-4964-824f-9378e30c933b tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:02.999839 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b1f83e58-b4a8-4964-824f-9378e30c933b tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:03.006249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b1f83e58-b4a8-4964-824f-9378e30c933b tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:03.006693 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b1f83e58-b4a8-4964-824f-9378e30c933b tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:03.007467 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b1f83e58-b4a8-4964-824f-9378e30c933b tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:03.007898 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b1f83e58-b4a8-4964-824f-9378e30c933b tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:03.024044 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-312f3e8d-4be3-472e-95c3-c1992ff5e599 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:03.032594 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-312f3e8d-4be3-472e-95c3-c1992ff5e599 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1756 microversion: 2.1 time: 0.172330 May 16 19:12:03.033419 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 300/616] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:02 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:03.091694 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-b1f83e58-b4a8-4964-824f-9378e30c933b tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lazy-loading 'services' on Instance uuid 6eee5cef-ceca-43ee-8c12-060886550585 {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:12:03.174913 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b1f83e58-b4a8-4964-824f-9378e30c933b tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "DELETE /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585/os-volume_attachments/dccfb195-cbd7-4ae8-8a39-a381806f2a18" status: 202 len: 0 microversion: 2.1 time: 0.179394 May 16 19:12:03.175542 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 317/617] 10.222.0.24 () {58 vars in 1415 bytes} [Mon May 16 19:12:02 2022] DELETE /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585/os-volume_attachments/dccfb195-cbd7-4ae8-8a39-a381806f2a18 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 19:12:03.722525 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-dcf26221-68a1-41e4-8fca-706e6a6197a1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:03.723067 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-dcf26221-68a1-41e4-8fca-706e6a6197a1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:03.730004 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dcf26221-68a1-41e4-8fca-706e6a6197a1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:03.730445 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dcf26221-68a1-41e4-8fca-706e6a6197a1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:03.731209 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dcf26221-68a1-41e4-8fca-706e6a6197a1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:03.731633 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dcf26221-68a1-41e4-8fca-706e6a6197a1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:03.946988 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-dcf26221-68a1-41e4-8fca-706e6a6197a1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:03.955153 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-dcf26221-68a1-41e4-8fca-706e6a6197a1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1676 microversion: 2.1 time: 0.236566 May 16 19:12:03.956455 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 301/618] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:03 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1676 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:04.050416 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-26b3c6a6-78f1-4669-a8c1-d325aa671c7c tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:04.051954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-26b3c6a6-78f1-4669-a8c1-d325aa671c7c tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:04.058959 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-26b3c6a6-78f1-4669-a8c1-d325aa671c7c tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:04.059398 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-26b3c6a6-78f1-4669-a8c1-d325aa671c7c tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:04.060160 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-26b3c6a6-78f1-4669-a8c1-d325aa671c7c tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:04.060587 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-26b3c6a6-78f1-4669-a8c1-d325aa671c7c tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:04.210621 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-26b3c6a6-78f1-4669-a8c1-d325aa671c7c tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:04.218668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-26b3c6a6-78f1-4669-a8c1-d325aa671c7c tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1756 microversion: 2.1 time: 0.172604 May 16 19:12:04.223059 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 318/619] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:04 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:04.973551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9ec33a4b-5ef2-43b4-990e-055e8c2421c3 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:04.974971 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9ec33a4b-5ef2-43b4-990e-055e8c2421c3 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:04.978440 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-efd6f911-b094-4747-97bb-29e70a696b2b req-79e3c762-bd6b-4c1c-b962-b79c441c7009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a385b0-58f3-4946-b6c6-2cbd20fe387f", "tag": "aadd3356-5374-4e27-aec5-d1a129d4438b"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:04.981301 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9ec33a4b-5ef2-43b4-990e-055e8c2421c3 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:04.981888 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9ec33a4b-5ef2-43b4-990e-055e8c2421c3 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:04.982813 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9ec33a4b-5ef2-43b4-990e-055e8c2421c3 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:04.983473 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9ec33a4b-5ef2-43b4-990e-055e8c2421c3 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:04.986364 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-efd6f911-b094-4747-97bb-29e70a696b2b req-79e3c762-bd6b-4c1c-b962-b79c441c7009 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:04.986807 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-efd6f911-b094-4747-97bb-29e70a696b2b req-79e3c762-bd6b-4c1c-b962-b79c441c7009 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:04.997673 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-efd6f911-b094-4747-97bb-29e70a696b2b req-79e3c762-bd6b-4c1c-b962-b79c441c7009 service nova] Creating event network-changed:aadd3356-5374-4e27-aec5-d1a129d4438b for instance 96a385b0-58f3-4946-b6c6-2cbd20fe387f on hv-cinder-76606 May 16 19:12:05.002670 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-efd6f911-b094-4747-97bb-29e70a696b2b req-79e3c762-bd6b-4c1c-b962-b79c441c7009 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027876 May 16 19:12:05.003585 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 319/620] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:12:05.197667 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-9ec33a4b-5ef2-43b4-990e-055e8c2421c3 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:05.206501 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9ec33a4b-5ef2-43b4-990e-055e8c2421c3 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1676 microversion: 2.1 time: 0.237891 May 16 19:12:05.207487 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 302/621] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:04 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1676 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:05.236977 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4012b1b1-f6ca-47ee-9dd1-346d036a4cfd tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:05.237709 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-4012b1b1-f6ca-47ee-9dd1-346d036a4cfd tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:05.243943 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4012b1b1-f6ca-47ee-9dd1-346d036a4cfd tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:05.244391 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4012b1b1-f6ca-47ee-9dd1-346d036a4cfd tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:05.245215 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4012b1b1-f6ca-47ee-9dd1-346d036a4cfd tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:05.245838 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4012b1b1-f6ca-47ee-9dd1-346d036a4cfd tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:05.363959 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8842438e-f3e2-43ff-b783-11846d417734 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:05.364612 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8842438e-f3e2-43ff-b783-11846d417734 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:05.371326 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8842438e-f3e2-43ff-b783-11846d417734 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:05.372481 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8842438e-f3e2-43ff-b783-11846d417734 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:05.373387 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8842438e-f3e2-43ff-b783-11846d417734 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:05.374051 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8842438e-f3e2-43ff-b783-11846d417734 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:05.402553 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8842438e-f3e2-43ff-b783-11846d417734 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Going to try to terminate instance {{(pid=117275) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:12:05.416811 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4012b1b1-f6ca-47ee-9dd1-346d036a4cfd tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:05.425959 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4012b1b1-f6ca-47ee-9dd1-346d036a4cfd tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1756 microversion: 2.1 time: 0.193712 May 16 19:12:05.427945 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 320/622] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:05 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:05.496013 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8842438e-f3e2-43ff-b783-11846d417734 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "DELETE /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 204 len: 0 microversion: 2.1 time: 0.135952 May 16 19:12:05.500126 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 303/623] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:12:05 2022] DELETE /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 19:12:05.511430 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9b150988-8c14-49a4-8413-cca6bf7d586d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:05.512689 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9b150988-8c14-49a4-8413-cca6bf7d586d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:05.519031 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9b150988-8c14-49a4-8413-cca6bf7d586d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:05.519719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9b150988-8c14-49a4-8413-cca6bf7d586d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:05.520583 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9b150988-8c14-49a4-8413-cca6bf7d586d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:05.521095 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9b150988-8c14-49a4-8413-cca6bf7d586d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:05.664314 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9b150988-8c14-49a4-8413-cca6bf7d586d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:05.674110 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9b150988-8c14-49a4-8413-cca6bf7d586d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1514 microversion: 2.1 time: 0.172258 May 16 19:12:05.674696 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 321/624] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:05 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:06.227900 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-778cc82b-2d14-41e6-9e76-2683298edeeb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:06.229120 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-778cc82b-2d14-41e6-9e76-2683298edeeb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:06.240078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-778cc82b-2d14-41e6-9e76-2683298edeeb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:06.240753 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-778cc82b-2d14-41e6-9e76-2683298edeeb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:06.242117 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-778cc82b-2d14-41e6-9e76-2683298edeeb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:06.242837 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-778cc82b-2d14-41e6-9e76-2683298edeeb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:06.376452 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-778cc82b-2d14-41e6-9e76-2683298edeeb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:06.384716 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-778cc82b-2d14-41e6-9e76-2683298edeeb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1676 microversion: 2.1 time: 0.164182 May 16 19:12:06.385289 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 304/625] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:06 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:06.447483 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2cefed46-8bf7-4a93-ac0d-f3304911f6b3 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:06.448419 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2cefed46-8bf7-4a93-ac0d-f3304911f6b3 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:06.459180 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2cefed46-8bf7-4a93-ac0d-f3304911f6b3 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:06.459910 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2cefed46-8bf7-4a93-ac0d-f3304911f6b3 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:06.461152 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2cefed46-8bf7-4a93-ac0d-f3304911f6b3 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:06.461924 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2cefed46-8bf7-4a93-ac0d-f3304911f6b3 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:06.603698 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2cefed46-8bf7-4a93-ac0d-f3304911f6b3 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:06.612349 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2cefed46-8bf7-4a93-ac0d-f3304911f6b3 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1756 microversion: 2.1 time: 0.171276 May 16 19:12:06.612903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 322/626] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:06 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:06.695862 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-7e9cbecb-afce-416a-baab-6acb8ec4838d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:06.696873 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-7e9cbecb-afce-416a-baab-6acb8ec4838d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:06.705797 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7e9cbecb-afce-416a-baab-6acb8ec4838d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:06.706241 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7e9cbecb-afce-416a-baab-6acb8ec4838d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:06.707009 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7e9cbecb-afce-416a-baab-6acb8ec4838d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:06.707439 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7e9cbecb-afce-416a-baab-6acb8ec4838d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:06.839476 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-7e9cbecb-afce-416a-baab-6acb8ec4838d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:06.847736 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-7e9cbecb-afce-416a-baab-6acb8ec4838d tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1514 microversion: 2.1 time: 0.158372 May 16 19:12:06.848304 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 305/627] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:06 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:07.405591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-76db1278-62fa-43d7-acde-cbfc847fda26 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:07.406608 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-76db1278-62fa-43d7-acde-cbfc847fda26 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:07.416848 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-76db1278-62fa-43d7-acde-cbfc847fda26 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:07.417599 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-76db1278-62fa-43d7-acde-cbfc847fda26 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:07.418874 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-76db1278-62fa-43d7-acde-cbfc847fda26 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:07.419589 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-76db1278-62fa-43d7-acde-cbfc847fda26 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:07.553210 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-76db1278-62fa-43d7-acde-cbfc847fda26 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:07.562261 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-76db1278-62fa-43d7-acde-cbfc847fda26 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1676 microversion: 2.1 time: 0.163265 May 16 19:12:07.562868 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 323/628] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:07 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:07.640810 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-fe9c0afd-f0f7-424a-bbda-2924de2b1f69 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:07.641636 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-fe9c0afd-f0f7-424a-bbda-2924de2b1f69 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:07.650833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fe9c0afd-f0f7-424a-bbda-2924de2b1f69 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:07.651433 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fe9c0afd-f0f7-424a-bbda-2924de2b1f69 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:07.652455 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fe9c0afd-f0f7-424a-bbda-2924de2b1f69 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:07.653036 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fe9c0afd-f0f7-424a-bbda-2924de2b1f69 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:07.864693 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-759cb2b1-a954-4659-8ff8-d053afe7d542 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:07.865294 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-759cb2b1-a954-4659-8ff8-d053afe7d542 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:07.872912 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-759cb2b1-a954-4659-8ff8-d053afe7d542 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:07.873679 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-759cb2b1-a954-4659-8ff8-d053afe7d542 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:07.874187 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-fe9c0afd-f0f7-424a-bbda-2924de2b1f69 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:07.875033 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-759cb2b1-a954-4659-8ff8-d053afe7d542 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:07.875715 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-759cb2b1-a954-4659-8ff8-d053afe7d542 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:07.885860 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-fe9c0afd-f0f7-424a-bbda-2924de2b1f69 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1756 microversion: 2.1 time: 0.252011 May 16 19:12:07.896288 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 306/629] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:07 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1756 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:08.008029 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-759cb2b1-a954-4659-8ff8-d053afe7d542 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:08.015832 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-759cb2b1-a954-4659-8ff8-d053afe7d542 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1514 microversion: 2.1 time: 0.155204 May 16 19:12:08.016414 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 324/630] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:07 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:08.517269 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-9f2c3456-8aea-485f-b6b0-b944d585745c req-f383325c-a90d-4757-878b-dea94670b48b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eee5cef-ceca-43ee-8c12-060886550585", "name": "network-vif-deleted", "tag": "64315f99-6584-4888-bfb0-c3b32c4b2501"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:08.526047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-9f2c3456-8aea-485f-b6b0-b944d585745c req-f383325c-a90d-4757-878b-dea94670b48b service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:08.526498 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-9f2c3456-8aea-485f-b6b0-b944d585745c req-f383325c-a90d-4757-878b-dea94670b48b service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:08.537996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-9f2c3456-8aea-485f-b6b0-b944d585745c req-f383325c-a90d-4757-878b-dea94670b48b service nova] Creating event network-vif-deleted:64315f99-6584-4888-bfb0-c3b32c4b2501 for instance 6eee5cef-ceca-43ee-8c12-060886550585 on hv-cinder-76606 May 16 19:12:08.543315 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-9f2c3456-8aea-485f-b6b0-b944d585745c req-f383325c-a90d-4757-878b-dea94670b48b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029807 May 16 19:12:08.544277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 307/631] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:12:08.579468 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d8c569af-5464-4793-9960-6deb962ea038 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:08.580178 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d8c569af-5464-4793-9960-6deb962ea038 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:08.586861 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d8c569af-5464-4793-9960-6deb962ea038 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:08.587381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d8c569af-5464-4793-9960-6deb962ea038 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:08.588214 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d8c569af-5464-4793-9960-6deb962ea038 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:08.588727 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d8c569af-5464-4793-9960-6deb962ea038 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:08.717461 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d8c569af-5464-4793-9960-6deb962ea038 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:08.725497 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d8c569af-5464-4793-9960-6deb962ea038 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1653 microversion: 2.1 time: 0.149911 May 16 19:12:08.726102 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 325/632] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:08 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1653 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:08.743406 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9be79fa9-6cfd-4276-8d9f-9434734706e8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:08.750106 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9be79fa9-6cfd-4276-8d9f-9434734706e8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:08.750540 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9be79fa9-6cfd-4276-8d9f-9434734706e8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:08.771947 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9be79fa9-6cfd-4276-8d9f-9434734706e8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Going to try to start instance {{(pid=117275) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 19:12:08.817302 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9be79fa9-6cfd-4276-8d9f-9434734706e8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "POST /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/action" status: 202 len: 0 microversion: 2.1 time: 0.078822 May 16 19:12:08.818257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 308/633] 10.222.0.24 () {60 vars in 1277 bytes} [Mon May 16 19:12:08 2022] POST /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:12:08.827312 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e0bf10c5-8b4e-4e7e-90e2-41335c8b23f2 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:08.827920 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e0bf10c5-8b4e-4e7e-90e2-41335c8b23f2 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:08.833973 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e0bf10c5-8b4e-4e7e-90e2-41335c8b23f2 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:08.834412 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e0bf10c5-8b4e-4e7e-90e2-41335c8b23f2 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:08.835172 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e0bf10c5-8b4e-4e7e-90e2-41335c8b23f2 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:08.835597 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e0bf10c5-8b4e-4e7e-90e2-41335c8b23f2 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:08.904277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1b924ebc-a565-4684-9b81-3301fd1ba43e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:08.905014 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1b924ebc-a565-4684-9b81-3301fd1ba43e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:08.911560 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1b924ebc-a565-4684-9b81-3301fd1ba43e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:08.912012 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1b924ebc-a565-4684-9b81-3301fd1ba43e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:08.912780 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1b924ebc-a565-4684-9b81-3301fd1ba43e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:08.913209 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1b924ebc-a565-4684-9b81-3301fd1ba43e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:08.980199 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e0bf10c5-8b4e-4e7e-90e2-41335c8b23f2 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:08.989828 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e0bf10c5-8b4e-4e7e-90e2-41335c8b23f2 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1662 microversion: 2.1 time: 0.166166 May 16 19:12:08.990421 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 326/634] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:08 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1662 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:09.033211 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-599d81b7-36c1-476d-a574-bbc5c3feab66 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:09.033845 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-599d81b7-36c1-476d-a574-bbc5c3feab66 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:09.040011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-599d81b7-36c1-476d-a574-bbc5c3feab66 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:09.040451 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-599d81b7-36c1-476d-a574-bbc5c3feab66 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:09.041238 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-599d81b7-36c1-476d-a574-bbc5c3feab66 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:09.041821 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-599d81b7-36c1-476d-a574-bbc5c3feab66 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:09.077488 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-599d81b7-36c1-476d-a574-bbc5c3feab66 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:09.077910 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-599d81b7-36c1-476d-a574-bbc5c3feab66 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:09.078470 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-599d81b7-36c1-476d-a574-bbc5c3feab66 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lazy-loading 'fault' on Instance uuid 6eee5cef-ceca-43ee-8c12-060886550585 {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:12:09.120882 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1b924ebc-a565-4684-9b81-3301fd1ba43e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:09.127033 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-599d81b7-36c1-476d-a574-bbc5c3feab66 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:09.128576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1b924ebc-a565-4684-9b81-3301fd1ba43e tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1756 microversion: 2.1 time: 0.228638 May 16 19:12:09.129172 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 309/635] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:08 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1756 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:09.134682 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-599d81b7-36c1-476d-a574-bbc5c3feab66 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 200 len: 1308 microversion: 2.1 time: 0.105322 May 16 19:12:09.135244 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 327/636] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:09 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:12:10.014982 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8b4be9c2-10c6-4c0c-ace2-535e9028bc65 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:10.016799 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8b4be9c2-10c6-4c0c-ace2-535e9028bc65 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:10.031807 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8b4be9c2-10c6-4c0c-ace2-535e9028bc65 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:10.032257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8b4be9c2-10c6-4c0c-ace2-535e9028bc65 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:10.033048 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8b4be9c2-10c6-4c0c-ace2-535e9028bc65 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:10.033481 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8b4be9c2-10c6-4c0c-ace2-535e9028bc65 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:10.145800 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0934e623-9030-4cad-8421-ea5afbb8b20a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:10.147148 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0934e623-9030-4cad-8421-ea5afbb8b20a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:10.154142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0934e623-9030-4cad-8421-ea5afbb8b20a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:10.154587 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0934e623-9030-4cad-8421-ea5afbb8b20a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:10.155356 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0934e623-9030-4cad-8421-ea5afbb8b20a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:10.155782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0934e623-9030-4cad-8421-ea5afbb8b20a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:10.170118 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8b4be9c2-10c6-4c0c-ace2-535e9028bc65 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:10.178072 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8b4be9c2-10c6-4c0c-ace2-535e9028bc65 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1662 microversion: 2.1 time: 0.173058 May 16 19:12:10.178728 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 310/637] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:10 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1662 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:10.191881 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-78afc023-b507-4794-9d3e-f962f050ef2e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:10.192491 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-78afc023-b507-4794-9d3e-f962f050ef2e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 6eee5cef-ceca-43ee-8c12-060886550585] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:10.198756 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-78afc023-b507-4794-9d3e-f962f050ef2e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:10.199204 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-78afc023-b507-4794-9d3e-f962f050ef2e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:10.199980 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-78afc023-b507-4794-9d3e-f962f050ef2e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:10.200416 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-78afc023-b507-4794-9d3e-f962f050ef2e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:10.215172 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-78afc023-b507-4794-9d3e-f962f050ef2e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] HTTP exception thrown: Instance 6eee5cef-ceca-43ee-8c12-060886550585 could not be found. May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-78afc023-b507-4794-9d3e-f962f050ef2e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Request method failure captured: May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 HTTP/1.1 May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqGfLdYAU2yWfv1qHdJUomB4kvQrle9E34wQOzoS03SquReRAMH3GRkxuEaVztclYjKFoEK5WowlaUf1KGpirV412P3DCwzxWPRzB0fQncbHaqhUA-YA6v-wE1zbYsSvJbLTd6Ye95rU0A4L933oGfW5jGsMCgItgdj0BU4EocBpqgI May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: 3f47a5832eba495e9a74266e13420ebb May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1034163992 May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:12:10.216857 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:12:10.218313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3f47a5832eba495e9a74266e13420ebb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3f47a5832eba495e9a74266e13420ebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3f47a5832eba495e9a74266e13420ebb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3f47a5832eba495e9a74266e13420ebb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:12:10.218313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-VolumesSnapshotTestJSON-1034163992 May 16 19:12:10.218313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: 3f47a5832eba495e9a74266e13420ebb May 16 19:12:10.218313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1034163992 May 16 19:12:10.218313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-VolumesSnapshotTestJSON-1034163992-project May 16 19:12:10.218313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:12:10.218313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:12:10.218313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 94079d9bd7b843f09e1345a79b51e447 May 16 19:12:10.218313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-VolumesSnapshotTestJSON-1034163992-project May 16 19:12:10.218313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:12:10.218313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance 6eee5cef-ceca-43ee-8c12-060886550585 could not be found. May 16 19:12:10.218313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': '6eee5cef-ceca-43ee-8c12-060886550585'} May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eee5cef-ceca-43ee-8c12-060886550585 could not be found. May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:12:10.219259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eee5cef-ceca-43ee-8c12-060886550585 could not be found. May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eee5cef-ceca-43ee-8c12-060886550585 could not be found. May 16 19:12:10.220521 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:12:10.221724 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-78afc023-b507-4794-9d3e-f962f050ef2e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Returning 404 to user: Instance 6eee5cef-ceca-43ee-8c12-060886550585 could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:12:10.221724 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-78afc023-b507-4794-9d3e-f962f050ef2e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585" status: 404 len: 111 microversion: 2.1 time: 0.030101 May 16 19:12:10.221724 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 311/638] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:10 2022] GET /compute/v2.1/servers/6eee5cef-ceca-43ee-8c12-060886550585 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:12:10.298767 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0934e623-9030-4cad-8421-ea5afbb8b20a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:10.306645 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0934e623-9030-4cad-8421-ea5afbb8b20a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1756 microversion: 2.1 time: 0.164788 May 16 19:12:10.316170 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 328/639] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:10 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:12:11.199383 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9c3cca86-7258-45ee-b527-66323a1d837f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:11.200022 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9c3cca86-7258-45ee-b527-66323a1d837f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:11.208127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9c3cca86-7258-45ee-b527-66323a1d837f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:11.208578 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9c3cca86-7258-45ee-b527-66323a1d837f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:11.209351 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9c3cca86-7258-45ee-b527-66323a1d837f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:11.209828 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9c3cca86-7258-45ee-b527-66323a1d837f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:11.324024 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-35b6c170-36fc-44e5-aa51-b0f59a431bf9 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:11.324555 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-35b6c170-36fc-44e5-aa51-b0f59a431bf9 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:11.331365 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-35b6c170-36fc-44e5-aa51-b0f59a431bf9 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:11.331813 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-35b6c170-36fc-44e5-aa51-b0f59a431bf9 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:11.332589 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-35b6c170-36fc-44e5-aa51-b0f59a431bf9 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:11.333024 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-35b6c170-36fc-44e5-aa51-b0f59a431bf9 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:11.345074 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-9c3cca86-7258-45ee-b527-66323a1d837f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:11.353029 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9c3cca86-7258-45ee-b527-66323a1d837f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1666 microversion: 2.1 time: 0.159676 May 16 19:12:11.353667 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 312/640] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:11 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:11.480693 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-35b6c170-36fc-44e5-aa51-b0f59a431bf9 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:11.493060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-35b6c170-36fc-44e5-aa51-b0f59a431bf9 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1756 microversion: 2.1 time: 0.172774 May 16 19:12:11.493977 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 329/641] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:11 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:12.514420 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c2c0f282-9281-4b55-a3c9-9b454ca77f4b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:12.515412 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c2c0f282-9281-4b55-a3c9-9b454ca77f4b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:12.526834 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c2c0f282-9281-4b55-a3c9-9b454ca77f4b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:12.527529 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c2c0f282-9281-4b55-a3c9-9b454ca77f4b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:12.528803 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c2c0f282-9281-4b55-a3c9-9b454ca77f4b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:12.529508 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c2c0f282-9281-4b55-a3c9-9b454ca77f4b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:12.681586 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c2c0f282-9281-4b55-a3c9-9b454ca77f4b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:12.693685 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c2c0f282-9281-4b55-a3c9-9b454ca77f4b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1756 microversion: 2.1 time: 0.185593 May 16 19:12:12.694483 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 313/642] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:12 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:13.715659 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7325b0a8-f506-4327-99d1-546880d11644 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:13.716334 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7325b0a8-f506-4327-99d1-546880d11644 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:13.723734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7325b0a8-f506-4327-99d1-546880d11644 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:13.724182 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7325b0a8-f506-4327-99d1-546880d11644 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:13.724953 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7325b0a8-f506-4327-99d1-546880d11644 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:13.725393 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7325b0a8-f506-4327-99d1-546880d11644 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:13.872049 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7325b0a8-f506-4327-99d1-546880d11644 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:13.880348 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7325b0a8-f506-4327-99d1-546880d11644 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1756 microversion: 2.1 time: 0.169364 May 16 19:12:13.880920 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 330/643] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:13 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:14.898350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-878dace0-cccd-477e-af56-bd37fd200334 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:14.898973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-878dace0-cccd-477e-af56-bd37fd200334 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:14.908959 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-878dace0-cccd-477e-af56-bd37fd200334 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:14.909412 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-878dace0-cccd-477e-af56-bd37fd200334 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:14.910583 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-878dace0-cccd-477e-af56-bd37fd200334 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:14.911023 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-878dace0-cccd-477e-af56-bd37fd200334 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:15.067597 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-878dace0-cccd-477e-af56-bd37fd200334 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:15.075580 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-878dace0-cccd-477e-af56-bd37fd200334 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1756 microversion: 2.1 time: 0.182361 May 16 19:12:15.076147 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 314/644] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:14 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:12:16.092677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-24df3f7f-edf1-4d53-8116-e5370223671a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:16.093246 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-24df3f7f-edf1-4d53-8116-e5370223671a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:16.100028 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-24df3f7f-edf1-4d53-8116-e5370223671a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:16.100487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-24df3f7f-edf1-4d53-8116-e5370223671a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:16.101247 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-24df3f7f-edf1-4d53-8116-e5370223671a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:16.101697 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-24df3f7f-edf1-4d53-8116-e5370223671a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:16.246077 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-24df3f7f-edf1-4d53-8116-e5370223671a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:16.254407 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-24df3f7f-edf1-4d53-8116-e5370223671a tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1759 microversion: 2.1 time: 0.165875 May 16 19:12:16.255006 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 331/645] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:16 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:19.122148 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d37494eb-daa5-4828-9b55-da6d2c2ebecf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1820330300", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452", "networks": [{"uuid": "65373252-c9ac-449c-8d31-248e5b6ba06c"}]}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:19.175451 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.network.neutron [None req-d37494eb-daa5-4828-9b55-da6d2c2ebecf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] validate_networks() for [('65373252-c9ac-449c-8d31-248e5b6ba06c', None, None, None, None, None)] {{(pid=117275) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:12:19.709095 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-d37494eb-daa5-4828-9b55-da6d2c2ebecf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Flavor limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:12:19.709681 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-d37494eb-daa5-4828-9b55-da6d2c2ebecf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Image limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:12:19.710133 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-d37494eb-daa5-4828-9b55-da6d2c2ebecf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Flavor pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:12:19.710537 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-d37494eb-daa5-4828-9b55-da6d2c2ebecf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Image pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:12:19.710943 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-d37494eb-daa5-4828-9b55-da6d2c2ebecf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:12:19.720642 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d37494eb-daa5-4828-9b55-da6d2c2ebecf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:19.721092 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d37494eb-daa5-4828-9b55-da6d2c2ebecf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:19.721942 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d37494eb-daa5-4828-9b55-da6d2c2ebecf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:19.722375 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d37494eb-daa5-4828-9b55-da6d2c2ebecf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:19.748289 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-d37494eb-daa5-4828-9b55-da6d2c2ebecf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Getting quotas for project 3f47a5832eba495e9a74266e13420ebb. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:12:19.755487 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-d37494eb-daa5-4828-9b55-da6d2c2ebecf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Getting quotas for user 94079d9bd7b843f09e1345a79b51e447 and project 3f47a5832eba495e9a74266e13420ebb. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:12:19.767090 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d37494eb-daa5-4828-9b55-da6d2c2ebecf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Going to run 1 instances... {{(pid=117275) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:12:19.769684 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d37494eb-daa5-4828-9b55-da6d2c2ebecf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:12:19.819278 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d37494eb-daa5-4828-9b55-da6d2c2ebecf tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701035 May 16 19:12:19.819971 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 315/646] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:12:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:12:19.835531 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-790703ac-88fd-4c3d-a37e-33424fda58a7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:19.836234 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-790703ac-88fd-4c3d-a37e-33424fda58a7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:19.892055 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-790703ac-88fd-4c3d-a37e-33424fda58a7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:19.899171 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-790703ac-88fd-4c3d-a37e-33424fda58a7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 200 len: 1219 microversion: 2.1 time: 0.069901 May 16 19:12:19.899809 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 332/647] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:19 2022] GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:20.919854 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-035e83d7-11ae-449a-82cd-c000e52c50f6 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:20.920449 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-035e83d7-11ae-449a-82cd-c000e52c50f6 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:20.928328 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-035e83d7-11ae-449a-82cd-c000e52c50f6 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:20.928778 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-035e83d7-11ae-449a-82cd-c000e52c50f6 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:20.929566 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-035e83d7-11ae-449a-82cd-c000e52c50f6 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:20.930001 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-035e83d7-11ae-449a-82cd-c000e52c50f6 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:20.992303 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-035e83d7-11ae-449a-82cd-c000e52c50f6 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:20.999884 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-035e83d7-11ae-449a-82cd-c000e52c50f6 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 200 len: 1271 microversion: 2.1 time: 0.087089 May 16 19:12:21.000457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 316/648] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:20 2022] GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:22.016999 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2d393f62-39a4-43af-990c-240c3a441922 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:22.017522 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2d393f62-39a4-43af-990c-240c3a441922 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:22.024354 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2d393f62-39a4-43af-990c-240c3a441922 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:22.024795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2d393f62-39a4-43af-990c-240c3a441922 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:22.025560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2d393f62-39a4-43af-990c-240c3a441922 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:22.026019 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2d393f62-39a4-43af-990c-240c3a441922 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:22.154208 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2d393f62-39a4-43af-990c-240c3a441922 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:22.162108 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2d393f62-39a4-43af-990c-240c3a441922 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.149055 May 16 19:12:22.164577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 333/649] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:22 2022] GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:22.460091 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-808f81fc-3154-4e8c-9526-dbf51f210648 req-0ebb85c9-2f2e-4954-ae91-775be32f6bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c82423-6014-4a34-b5fd-2386a32d7a9f", "tag": "34b2cb1d-a1fe-42c4-89ca-0964ac9881e8"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:22.468702 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-808f81fc-3154-4e8c-9526-dbf51f210648 req-0ebb85c9-2f2e-4954-ae91-775be32f6bfa service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:22.469218 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-808f81fc-3154-4e8c-9526-dbf51f210648 req-0ebb85c9-2f2e-4954-ae91-775be32f6bfa service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:22.480536 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-808f81fc-3154-4e8c-9526-dbf51f210648 req-0ebb85c9-2f2e-4954-ae91-775be32f6bfa service nova] Creating event network-changed:34b2cb1d-a1fe-42c4-89ca-0964ac9881e8 for instance 29c82423-6014-4a34-b5fd-2386a32d7a9f on hv-cinder-76606 May 16 19:12:22.485855 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-808f81fc-3154-4e8c-9526-dbf51f210648 req-0ebb85c9-2f2e-4954-ae91-775be32f6bfa service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029390 May 16 19:12:22.486835 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 317/650] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:12:23.182641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4e584d40-c5a9-446a-b833-7f7a0fe3e19e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:23.183265 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-4e584d40-c5a9-446a-b833-7f7a0fe3e19e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:23.192589 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4e584d40-c5a9-446a-b833-7f7a0fe3e19e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:23.193277 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4e584d40-c5a9-446a-b833-7f7a0fe3e19e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:23.194426 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4e584d40-c5a9-446a-b833-7f7a0fe3e19e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:23.194975 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4e584d40-c5a9-446a-b833-7f7a0fe3e19e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:23.547473 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4e584d40-c5a9-446a-b833-7f7a0fe3e19e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:23.554939 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4e584d40-c5a9-446a-b833-7f7a0fe3e19e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.377697 May 16 19:12:23.555512 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 334/651] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:23 2022] GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:24.442948 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-bae7c683-35c3-4cb1-b6dc-4c09bea326bf tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:24.443517 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-bae7c683-35c3-4cb1-b6dc-4c09bea326bf tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:24.450188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bae7c683-35c3-4cb1-b6dc-4c09bea326bf tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:24.450628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bae7c683-35c3-4cb1-b6dc-4c09bea326bf tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:24.451419 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bae7c683-35c3-4cb1-b6dc-4c09bea326bf tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:24.451850 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bae7c683-35c3-4cb1-b6dc-4c09bea326bf tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:24.476879 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-bae7c683-35c3-4cb1-b6dc-4c09bea326bf tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1/ips" status: 200 len: 150 microversion: 2.1 time: 0.038971 May 16 19:12:24.477469 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 318/652] 10.222.0.24 () {58 vars in 1247 bytes} [Mon May 16 19:12:24 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:12:24.488487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-478170d3-956f-44cb-8a89-4983032248c5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17a42e5e-9a96-4798-81cf-c57aa1c25f0c"}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:24.489682 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-478170d3-956f-44cb-8a89-4983032248c5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:24.496851 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-478170d3-956f-44cb-8a89-4983032248c5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:24.497366 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-478170d3-956f-44cb-8a89-4983032248c5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:24.498184 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-478170d3-956f-44cb-8a89-4983032248c5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:24.498637 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-478170d3-956f-44cb-8a89-4983032248c5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:24.572102 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-32eeff9e-0c2d-42eb-9cba-265a2ed60193 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:24.572953 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-32eeff9e-0c2d-42eb-9cba-265a2ed60193 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:24.579871 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-32eeff9e-0c2d-42eb-9cba-265a2ed60193 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:24.580318 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-32eeff9e-0c2d-42eb-9cba-265a2ed60193 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:24.581104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-32eeff9e-0c2d-42eb-9cba-265a2ed60193 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:24.581762 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-32eeff9e-0c2d-42eb-9cba-265a2ed60193 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:24.583343 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-478170d3-956f-44cb-8a89-4983032248c5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] HTTP exception thrown: Invalid volume: volume 17a42e5e-9a96-4798-81cf-c57aa1c25f0c is already attached to instances: 43ade137-6172-4f24-80ef-9e84b6fb6df7 May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-478170d3-956f-44cb-8a89-4983032248c5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Request method failure captured: May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: POST /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1/os-volume_attachments HTTP/1.1 May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 74 May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqEkfBgf-5XfH-1I-yuCRcEsCpbyBI1UoIvKz5FJMT4bGAMlNwLp0yu1A3yPkFIrpPBwb538SaogfPDVB6aYcwOKGjLO5ozfcqhZhnWzIyH6lLDvijCwB-q9kEmQJZsKm_pVPahD7yWMKKOQtIBayABLCJCDJpGvPEjaCIlQWvmenMs May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:12:24.585405 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:12:24.586734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:12:24.586734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:12:24.586734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:12:24.586734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:12:24.586734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:12:24.586734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:12:24.586734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:12:24.586734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 7d3af11e1ffc4ab1a37669f893d2f3be May 16 19:12:24.586734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:12:24.586734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: May 16 19:12:24.586734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {"volumeAttachment": {"volumeId": "17a42e5e-9a96-4798-81cf-c57aa1c25f0c"}} May 16 19:12:24.586734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Invalid volume: volume 17a42e5e-9a96-4798-81cf-c57aa1c25f0c is already attached to instances: 43ade137-6172-4f24-80ef-9e84b6fb6df7 May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'server_id': '73fbf87a-3557-408c-ac54-e6ca9017a0f1', 'body': {'volumeAttachment': {'volumeId': '17a42e5e-9a96-4798-81cf-c57aa1c25f0c'}}} May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 17a42e5e-9a96-4798-81cf-c57aa1c25f0c is already attached to instances: 43ade137-6172-4f24-80ef-9e84b6fb6df7 May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:12:24.587476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 17a42e5e-9a96-4798-81cf-c57aa1c25f0c is already attached to instances: 43ade137-6172-4f24-80ef-9e84b6fb6df7 May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:12:24.588652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:12:24.589883 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:12:24.589883 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:12:24.589883 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:12:24.589883 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 17a42e5e-9a96-4798-81cf-c57aa1c25f0c is already attached to instances: 43ade137-6172-4f24-80ef-9e84b6fb6df7 May 16 19:12:24.589883 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:12:24.589883 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-478170d3-956f-44cb-8a89-4983032248c5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Returning 400 to user: Invalid volume: volume 17a42e5e-9a96-4798-81cf-c57aa1c25f0c is already attached to instances: 43ade137-6172-4f24-80ef-9e84b6fb6df7 {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:12:24.589883 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-478170d3-956f-44cb-8a89-4983032248c5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "POST /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102753 May 16 19:12:24.589883 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 335/653] 10.222.0.24 () {60 vars in 1322 bytes} [Mon May 16 19:12:24 2022] POST /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 19:12:24.596825 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-bd328594-de85-4cb1-90ad-3bcc6ea9e4e7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:24.597329 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-bd328594-de85-4cb1-90ad-3bcc6ea9e4e7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:24.605963 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd328594-de85-4cb1-90ad-3bcc6ea9e4e7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:24.606421 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd328594-de85-4cb1-90ad-3bcc6ea9e4e7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:24.607208 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd328594-de85-4cb1-90ad-3bcc6ea9e4e7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:24.607647 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd328594-de85-4cb1-90ad-3bcc6ea9e4e7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:24.633283 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-bd328594-de85-4cb1-90ad-3bcc6ea9e4e7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Going to try to terminate instance {{(pid=117274) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:12:24.718494 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-bd328594-de85-4cb1-90ad-3bcc6ea9e4e7 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "DELETE /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 204 len: 0 microversion: 2.1 time: 0.125301 May 16 19:12:24.722337 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 336/654] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:12:24 2022] DELETE /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 19:12:24.729823 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-95f71bca-2832-4a64-903d-625f86207170 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:24.730545 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-95f71bca-2832-4a64-903d-625f86207170 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:24.738375 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-95f71bca-2832-4a64-903d-625f86207170 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:24.739064 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-95f71bca-2832-4a64-903d-625f86207170 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:24.740028 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-95f71bca-2832-4a64-903d-625f86207170 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:24.740654 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-95f71bca-2832-4a64-903d-625f86207170 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:24.806139 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-32eeff9e-0c2d-42eb-9cba-265a2ed60193 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:24.814492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-32eeff9e-0c2d-42eb-9cba-265a2ed60193 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.246404 May 16 19:12:24.815160 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 319/655] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:24 2022] GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:24.878801 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-95f71bca-2832-4a64-903d-625f86207170 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:24.886320 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-95f71bca-2832-4a64-903d-625f86207170 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1683 microversion: 2.1 time: 0.161839 May 16 19:12:24.886852 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 337/656] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:24 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:25.835813 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-bff333f6-ae4c-4bf0-a7e5-879507d321bc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:25.836760 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-bff333f6-ae4c-4bf0-a7e5-879507d321bc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:25.847025 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bff333f6-ae4c-4bf0-a7e5-879507d321bc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:25.847482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bff333f6-ae4c-4bf0-a7e5-879507d321bc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:25.848252 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bff333f6-ae4c-4bf0-a7e5-879507d321bc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:25.848688 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bff333f6-ae4c-4bf0-a7e5-879507d321bc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:25.904563 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-36efdbfd-7bf7-45c0-a68a-1b93ecf5b470 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:25.905180 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-36efdbfd-7bf7-45c0-a68a-1b93ecf5b470 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:25.912003 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-36efdbfd-7bf7-45c0-a68a-1b93ecf5b470 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:25.912456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-36efdbfd-7bf7-45c0-a68a-1b93ecf5b470 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:25.913220 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-36efdbfd-7bf7-45c0-a68a-1b93ecf5b470 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:25.913689 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-36efdbfd-7bf7-45c0-a68a-1b93ecf5b470 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:25.986833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-bff333f6-ae4c-4bf0-a7e5-879507d321bc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:25.995045 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-bff333f6-ae4c-4bf0-a7e5-879507d321bc tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.165898 May 16 19:12:25.995848 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 320/657] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:25 2022] GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:26.043668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-36efdbfd-7bf7-45c0-a68a-1b93ecf5b470 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:26.051589 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-36efdbfd-7bf7-45c0-a68a-1b93ecf5b470 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1683 microversion: 2.1 time: 0.150960 May 16 19:12:26.052398 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 338/658] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:25 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:27.012431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1a8a7ff7-34e6-4a3d-a103-eec2a6497b12 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:27.013030 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1a8a7ff7-34e6-4a3d-a103-eec2a6497b12 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:27.019766 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1a8a7ff7-34e6-4a3d-a103-eec2a6497b12 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:27.020214 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1a8a7ff7-34e6-4a3d-a103-eec2a6497b12 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:27.020972 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1a8a7ff7-34e6-4a3d-a103-eec2a6497b12 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:27.021400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1a8a7ff7-34e6-4a3d-a103-eec2a6497b12 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:27.068362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e5946f0a-56a6-48ce-ae02-f654b02f8d12 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:27.069077 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e5946f0a-56a6-48ce-ae02-f654b02f8d12 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:27.080017 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5946f0a-56a6-48ce-ae02-f654b02f8d12 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:27.080458 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5946f0a-56a6-48ce-ae02-f654b02f8d12 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:27.081261 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5946f0a-56a6-48ce-ae02-f654b02f8d12 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:27.081763 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5946f0a-56a6-48ce-ae02-f654b02f8d12 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:27.215441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e5946f0a-56a6-48ce-ae02-f654b02f8d12 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:27.223035 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e5946f0a-56a6-48ce-ae02-f654b02f8d12 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 200 len: 1683 microversion: 2.1 time: 0.158646 May 16 19:12:27.223606 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 339/659] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:27 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:27.226699 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1a8a7ff7-34e6-4a3d-a103-eec2a6497b12 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:27.235961 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1a8a7ff7-34e6-4a3d-a103-eec2a6497b12 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.227304 May 16 19:12:27.246847 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 321/660] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:27 2022] GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:27.553325 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-f5f41d0b-ce5b-411d-b7b5-dad69c63be20 req-3e48ff7e-da5c-460f-bb6f-49fbde1f12c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fbf87a-3557-408c-ac54-e6ca9017a0f1", "name": "network-vif-deleted", "tag": "4c82ce8d-f16a-4001-99f0-aa83af3c4315"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:27.562084 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-f5f41d0b-ce5b-411d-b7b5-dad69c63be20 req-3e48ff7e-da5c-460f-bb6f-49fbde1f12c7 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:27.563387 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-f5f41d0b-ce5b-411d-b7b5-dad69c63be20 req-3e48ff7e-da5c-460f-bb6f-49fbde1f12c7 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:27.576336 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-f5f41d0b-ce5b-411d-b7b5-dad69c63be20 req-3e48ff7e-da5c-460f-bb6f-49fbde1f12c7 service nova] Creating event network-vif-deleted:4c82ce8d-f16a-4001-99f0-aa83af3c4315 for instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 on hv-cinder-76606 May 16 19:12:27.582544 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-f5f41d0b-ce5b-411d-b7b5-dad69c63be20 req-3e48ff7e-da5c-460f-bb6f-49fbde1f12c7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032467 May 16 19:12:27.583372 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 340/661] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:12:28.240477 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-735335f2-17c4-407d-a6ce-cb6ba3a411f5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:28.241222 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-735335f2-17c4-407d-a6ce-cb6ba3a411f5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:28.254402 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-dbb7dd3e-17d7-49bf-a92c-c7cf955106e7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:28.255222 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-dbb7dd3e-17d7-49bf-a92c-c7cf955106e7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:28.258501 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-735335f2-17c4-407d-a6ce-cb6ba3a411f5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:28.259184 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-735335f2-17c4-407d-a6ce-cb6ba3a411f5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:28.260496 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-735335f2-17c4-407d-a6ce-cb6ba3a411f5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:28.260850 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-735335f2-17c4-407d-a6ce-cb6ba3a411f5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:28.267471 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dbb7dd3e-17d7-49bf-a92c-c7cf955106e7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:28.268188 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dbb7dd3e-17d7-49bf-a92c-c7cf955106e7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:28.269019 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dbb7dd3e-17d7-49bf-a92c-c7cf955106e7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:28.269450 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dbb7dd3e-17d7-49bf-a92c-c7cf955106e7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:28.285561 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-735335f2-17c4-407d-a6ce-cb6ba3a411f5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] HTTP exception thrown: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-735335f2-17c4-407d-a6ce-cb6ba3a411f5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Request method failure captured: May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 HTTP/1.1 May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqEkfBgf-5XfH-1I-yuCRcEsCpbyBI1UoIvKz5FJMT4bGAMlNwLp0yu1A3yPkFIrpPBwb538SaogfPDVB6aYcwOKGjLO5ozfcqhZhnWzIyH6lLDvijCwB-q9kEmQJZsKm_pVPahD7yWMKKOQtIBayABLCJCDJpGvPEjaCIlQWvmenMs May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:12:28.289648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:12:28.291198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:12:28.291198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:12:28.291198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:12:28.291198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:12:28.291198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:12:28.291198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:12:28.291198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:12:28.291198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 7d3af11e1ffc4ab1a37669f893d2f3be May 16 19:12:28.291198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:12:28.291198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:12:28.291198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. May 16 19:12:28.291198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': '73fbf87a-3557-408c-ac54-e6ca9017a0f1'} May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:12:28.292213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. May 16 19:12:28.293431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:12:28.294487 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-735335f2-17c4-407d-a6ce-cb6ba3a411f5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Returning 404 to user: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:12:28.294487 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-735335f2-17c4-407d-a6ce-cb6ba3a411f5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 404 len: 111 microversion: 2.1 time: 0.056839 May 16 19:12:28.294487 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 322/662] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:28 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:12:28.302581 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e09d7216-e214-4730-bd4c-f62f760b497b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '.version_select at 0x7f1e0be875e0>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:28.326214 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e09d7216-e214-4730-bd4c-f62f760b497b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015605764" status: 202 len: 0 microversion: 2.1 time: 0.027501 May 16 19:12:28.326991 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 323/663] 10.222.0.24 () {58 vars in 1220 bytes} [Mon May 16 19:12:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015605764 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:12:28.423970 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-dbb7dd3e-17d7-49bf-a92c-c7cf955106e7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:28.432301 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-dbb7dd3e-17d7-49bf-a92c-c7cf955106e7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.182209 May 16 19:12:28.432893 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 341/664] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:28 2022] GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:28.849982 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-fa335ef2-440d-4578-9d98-b95eae40cd09 req-588cbb3a-9622-4e0b-8673-c8286a35e2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c82423-6014-4a34-b5fd-2386a32d7a9f", "name": "network-vif-plugged", "status": "completed", "tag": "34b2cb1d-a1fe-42c4-89ca-0964ac9881e8"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:28.859509 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-fa335ef2-440d-4578-9d98-b95eae40cd09 req-588cbb3a-9622-4e0b-8673-c8286a35e2e1 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:28.860421 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-fa335ef2-440d-4578-9d98-b95eae40cd09 req-588cbb3a-9622-4e0b-8673-c8286a35e2e1 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:28.871845 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-fa335ef2-440d-4578-9d98-b95eae40cd09 req-588cbb3a-9622-4e0b-8673-c8286a35e2e1 service nova] Creating event network-vif-plugged:34b2cb1d-a1fe-42c4-89ca-0964ac9881e8 for instance 29c82423-6014-4a34-b5fd-2386a32d7a9f on hv-cinder-76606 May 16 19:12:28.877579 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-fa335ef2-440d-4578-9d98-b95eae40cd09 req-588cbb3a-9622-4e0b-8673-c8286a35e2e1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032220 May 16 19:12:28.878718 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 324/665] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:12:29.065584 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-fb9c6cc7-0c6c-46e6-be89-6e57b7eb9220 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:29.066175 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-fb9c6cc7-0c6c-46e6-be89-6e57b7eb9220 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:29.073109 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb9c6cc7-0c6c-46e6-be89-6e57b7eb9220 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:29.073677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb9c6cc7-0c6c-46e6-be89-6e57b7eb9220 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:29.074656 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb9c6cc7-0c6c-46e6-be89-6e57b7eb9220 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:29.075177 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb9c6cc7-0c6c-46e6-be89-6e57b7eb9220 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:29.165035 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-fb9c6cc7-0c6c-46e6-be89-6e57b7eb9220 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lazy-loading 'services' on Instance uuid 43ade137-6172-4f24-80ef-9e84b6fb6df7 {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:12:29.238246 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-fb9c6cc7-0c6c-46e6-be89-6e57b7eb9220 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "DELETE /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7/os-volume_attachments/17a42e5e-9a96-4798-81cf-c57aa1c25f0c" status: 202 len: 0 microversion: 2.1 time: 0.176389 May 16 19:12:29.243081 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 342/666] 10.222.0.24 () {58 vars in 1415 bytes} [Mon May 16 19:12:29 2022] DELETE /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7/os-volume_attachments/17a42e5e-9a96-4798-81cf-c57aa1c25f0c => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:12:29.250219 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1acb31fd-ba42-44e4-9292-b121922ce612 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:29.252989 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1acb31fd-ba42-44e4-9292-b121922ce612 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:29.258633 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1acb31fd-ba42-44e4-9292-b121922ce612 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:29.259164 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1acb31fd-ba42-44e4-9292-b121922ce612 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:29.259998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1acb31fd-ba42-44e4-9292-b121922ce612 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:29.260644 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1acb31fd-ba42-44e4-9292-b121922ce612 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:29.289685 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1acb31fd-ba42-44e4-9292-b121922ce612 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045263 May 16 19:12:29.290244 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 325/667] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:12:29 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:12:29.450851 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f9117b9a-1eca-4299-a577-bfc867423441 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:29.451552 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f9117b9a-1eca-4299-a577-bfc867423441 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:29.458640 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f9117b9a-1eca-4299-a577-bfc867423441 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:29.459023 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f9117b9a-1eca-4299-a577-bfc867423441 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:29.459836 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f9117b9a-1eca-4299-a577-bfc867423441 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:29.460269 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f9117b9a-1eca-4299-a577-bfc867423441 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:29.595291 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f9117b9a-1eca-4299-a577-bfc867423441 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:29.603384 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f9117b9a-1eca-4299-a577-bfc867423441 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.157873 May 16 19:12:29.603965 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 343/668] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:29 2022] GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:30.302155 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1fa600d3-7395-42bb-9d8d-9ea9923725cc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:30.303323 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1fa600d3-7395-42bb-9d8d-9ea9923725cc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:30.310403 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1fa600d3-7395-42bb-9d8d-9ea9923725cc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:30.311005 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1fa600d3-7395-42bb-9d8d-9ea9923725cc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:30.311648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1fa600d3-7395-42bb-9d8d-9ea9923725cc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:30.312073 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1fa600d3-7395-42bb-9d8d-9ea9923725cc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:30.344995 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1fa600d3-7395-42bb-9d8d-9ea9923725cc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046940 May 16 19:12:30.345665 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 326/669] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:12:30 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:12:30.619997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c14744e5-fa30-40dc-8910-d50e82355702 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:30.620610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c14744e5-fa30-40dc-8910-d50e82355702 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:30.627173 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c14744e5-fa30-40dc-8910-d50e82355702 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:30.627635 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c14744e5-fa30-40dc-8910-d50e82355702 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:30.628411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c14744e5-fa30-40dc-8910-d50e82355702 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:30.628838 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c14744e5-fa30-40dc-8910-d50e82355702 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:30.766862 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c14744e5-fa30-40dc-8910-d50e82355702 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:30.775929 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c14744e5-fa30-40dc-8910-d50e82355702 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.159896 May 16 19:12:30.777384 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 344/670] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:30 2022] GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:31.360258 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e7cdc2ad-4843-42f6-bb38-dde3d5d87c70 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:31.361352 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e7cdc2ad-4843-42f6-bb38-dde3d5d87c70 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:31.369547 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e7cdc2ad-4843-42f6-bb38-dde3d5d87c70 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:31.370029 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e7cdc2ad-4843-42f6-bb38-dde3d5d87c70 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:31.370807 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e7cdc2ad-4843-42f6-bb38-dde3d5d87c70 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:31.371237 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e7cdc2ad-4843-42f6-bb38-dde3d5d87c70 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:31.402164 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e7cdc2ad-4843-42f6-bb38-dde3d5d87c70 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047651 May 16 19:12:31.402641 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 327/671] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:12:31 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:12:31.796269 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2843177d-0c1d-4dca-96dc-ff99a9f2d970 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:31.797168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2843177d-0c1d-4dca-96dc-ff99a9f2d970 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:31.807052 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2843177d-0c1d-4dca-96dc-ff99a9f2d970 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:31.807719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2843177d-0c1d-4dca-96dc-ff99a9f2d970 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:31.808906 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2843177d-0c1d-4dca-96dc-ff99a9f2d970 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:31.809472 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2843177d-0c1d-4dca-96dc-ff99a9f2d970 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:31.941836 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2843177d-0c1d-4dca-96dc-ff99a9f2d970 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:31.950057 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2843177d-0c1d-4dca-96dc-ff99a9f2d970 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 200 len: 1509 microversion: 2.1 time: 0.159748 May 16 19:12:31.950608 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 345/672] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:31 2022] GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:31.968893 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-03bbeb17-5d7b-4a17-81be-6319809a5597 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bee6fb34-e3f2-4c99-bfab-f074e5e004d4", "device": "/dev/sdb"}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:31.970604 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-03bbeb17-5d7b-4a17-81be-6319809a5597 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:31.976708 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-03bbeb17-5d7b-4a17-81be-6319809a5597 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:31.977162 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-03bbeb17-5d7b-4a17-81be-6319809a5597 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:31.977960 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-03bbeb17-5d7b-4a17-81be-6319809a5597 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:31.978404 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-03bbeb17-5d7b-4a17-81be-6319809a5597 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:32.249866 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-03bbeb17-5d7b-4a17-81be-6319809a5597 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "POST /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287173 May 16 19:12:32.250549 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 328/673] 10.222.0.24 () {60 vars in 1322 bytes} [Mon May 16 19:12:31 2022] POST /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:12:32.414341 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-aab22b53-6419-4a1f-b3ca-bf8beeb0e03b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:32.415342 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-aab22b53-6419-4a1f-b3ca-bf8beeb0e03b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:32.421326 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-aab22b53-6419-4a1f-b3ca-bf8beeb0e03b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:32.421803 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-aab22b53-6419-4a1f-b3ca-bf8beeb0e03b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:32.422567 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-aab22b53-6419-4a1f-b3ca-bf8beeb0e03b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:32.422993 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-aab22b53-6419-4a1f-b3ca-bf8beeb0e03b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:32.452806 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-aab22b53-6419-4a1f-b3ca-bf8beeb0e03b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042549 May 16 19:12:32.453320 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 346/674] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:12:32 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 19:12:32.510594 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b9bfac63-47e8-41c0-acc5-94ac664a0f42 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:32.511134 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b9bfac63-47e8-41c0-acc5-94ac664a0f42 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:32.517460 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b9bfac63-47e8-41c0-acc5-94ac664a0f42 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:32.517935 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b9bfac63-47e8-41c0-acc5-94ac664a0f42 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:32.518691 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b9bfac63-47e8-41c0-acc5-94ac664a0f42 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:32.519120 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b9bfac63-47e8-41c0-acc5-94ac664a0f42 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:32.544601 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b9bfac63-47e8-41c0-acc5-94ac664a0f42 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Going to try to terminate instance {{(pid=117275) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:12:32.631635 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b9bfac63-47e8-41c0-acc5-94ac664a0f42 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "DELETE /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 204 len: 0 microversion: 2.1 time: 0.125521 May 16 19:12:32.632134 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 329/675] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:12:32 2022] DELETE /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 19:12:32.640517 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b1bee160-0409-47a0-a7b6-05b0c66e2c0c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:32.641167 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b1bee160-0409-47a0-a7b6-05b0c66e2c0c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:32.647977 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b1bee160-0409-47a0-a7b6-05b0c66e2c0c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:32.648418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b1bee160-0409-47a0-a7b6-05b0c66e2c0c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:32.649187 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b1bee160-0409-47a0-a7b6-05b0c66e2c0c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:32.649641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b1bee160-0409-47a0-a7b6-05b0c66e2c0c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:32.783053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b1bee160-0409-47a0-a7b6-05b0c66e2c0c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:32.794261 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b1bee160-0409-47a0-a7b6-05b0c66e2c0c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1680 microversion: 2.1 time: 0.157309 May 16 19:12:32.795102 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 347/676] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:32 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:33.814715 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-32e812e7-ccba-4bf7-b0d2-6238f91d282e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:33.815387 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-32e812e7-ccba-4bf7-b0d2-6238f91d282e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:33.823245 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-32e812e7-ccba-4bf7-b0d2-6238f91d282e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:33.823765 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-32e812e7-ccba-4bf7-b0d2-6238f91d282e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:33.824691 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-32e812e7-ccba-4bf7-b0d2-6238f91d282e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:33.825196 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-32e812e7-ccba-4bf7-b0d2-6238f91d282e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:33.956110 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-32e812e7-ccba-4bf7-b0d2-6238f91d282e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:33.965929 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-32e812e7-ccba-4bf7-b0d2-6238f91d282e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1680 microversion: 2.1 time: 0.156501 May 16 19:12:33.966773 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 330/677] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:33 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:34.987599 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-760addfe-3ef1-42be-8b91-852b15a78154 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:34.988232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-760addfe-3ef1-42be-8b91-852b15a78154 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:34.995287 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-760addfe-3ef1-42be-8b91-852b15a78154 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:34.995730 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-760addfe-3ef1-42be-8b91-852b15a78154 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:34.996493 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-760addfe-3ef1-42be-8b91-852b15a78154 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:34.996950 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-760addfe-3ef1-42be-8b91-852b15a78154 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:35.131018 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-760addfe-3ef1-42be-8b91-852b15a78154 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:35.138618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-760addfe-3ef1-42be-8b91-852b15a78154 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1680 microversion: 2.1 time: 0.156750 May 16 19:12:35.139194 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 348/678] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:34 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:35.889092 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-d844e402-2333-462e-b127-568465cb69cd req-161f51d3-9db3-4b1d-8b12-3c34024758f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ade137-6172-4f24-80ef-9e84b6fb6df7", "name": "network-vif-deleted", "tag": "417ef627-ac75-48a8-b654-6f19e3e9c733"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:35.899257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-d844e402-2333-462e-b127-568465cb69cd req-161f51d3-9db3-4b1d-8b12-3c34024758f0 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:35.899682 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-d844e402-2333-462e-b127-568465cb69cd req-161f51d3-9db3-4b1d-8b12-3c34024758f0 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:35.911170 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-d844e402-2333-462e-b127-568465cb69cd req-161f51d3-9db3-4b1d-8b12-3c34024758f0 service nova] Creating event network-vif-deleted:417ef627-ac75-48a8-b654-6f19e3e9c733 for instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 on hv-cinder-76606 May 16 19:12:35.916744 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-d844e402-2333-462e-b127-568465cb69cd req-161f51d3-9db3-4b1d-8b12-3c34024758f0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031248 May 16 19:12:35.920426 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 331/679] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:12:36.156377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f07630ca-02d3-4173-ac7d-e1f79c9bbf9f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:36.157091 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f07630ca-02d3-4173-ac7d-e1f79c9bbf9f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:36.165093 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f07630ca-02d3-4173-ac7d-e1f79c9bbf9f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:36.165307 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f07630ca-02d3-4173-ac7d-e1f79c9bbf9f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:36.166141 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f07630ca-02d3-4173-ac7d-e1f79c9bbf9f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:36.166569 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f07630ca-02d3-4173-ac7d-e1f79c9bbf9f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:36.197647 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f07630ca-02d3-4173-ac7d-e1f79c9bbf9f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:36.198011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f07630ca-02d3-4173-ac7d-e1f79c9bbf9f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:36.198480 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-f07630ca-02d3-4173-ac7d-e1f79c9bbf9f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lazy-loading 'fault' on Instance uuid 43ade137-6172-4f24-80ef-9e84b6fb6df7 {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:12:36.238612 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f07630ca-02d3-4173-ac7d-e1f79c9bbf9f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:36.246157 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f07630ca-02d3-4173-ac7d-e1f79c9bbf9f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 200 len: 1332 microversion: 2.1 time: 0.093724 May 16 19:12:36.246786 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 349/680] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:36 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:37.269123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-31f27a91-0b32-4ab5-87b0-3099eeb28454 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:37.269953 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-31f27a91-0b32-4ab5-87b0-3099eeb28454 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:37.276983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-31f27a91-0b32-4ab5-87b0-3099eeb28454 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:37.277425 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-31f27a91-0b32-4ab5-87b0-3099eeb28454 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:37.278229 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-31f27a91-0b32-4ab5-87b0-3099eeb28454 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:37.278664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-31f27a91-0b32-4ab5-87b0-3099eeb28454 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:37.292395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-31f27a91-0b32-4ab5-87b0-3099eeb28454 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] HTTP exception thrown: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-31f27a91-0b32-4ab5-87b0-3099eeb28454 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Request method failure captured: May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 HTTP/1.1 May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqEkfBgf-5XfH-1I-yuCRcEsCpbyBI1UoIvKz5FJMT4bGAMlNwLp0yu1A3yPkFIrpPBwb538SaogfPDVB6aYcwOKGjLO5ozfcqhZhnWzIyH6lLDvijCwB-q9kEmQJZsKm_pVPahD7yWMKKOQtIBayABLCJCDJpGvPEjaCIlQWvmenMs May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:12:37.294043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:12:37.295611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:12:37.295611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:12:37.295611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:12:37.295611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:12:37.295611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:12:37.295611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:12:37.295611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:12:37.295611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 7d3af11e1ffc4ab1a37669f893d2f3be May 16 19:12:37.295611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:12:37.295611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:12:37.295611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. May 16 19:12:37.295611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': '43ade137-6172-4f24-80ef-9e84b6fb6df7'} May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:12:37.296431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. May 16 19:12:37.297650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:12:37.298776 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-31f27a91-0b32-4ab5-87b0-3099eeb28454 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Returning 404 to user: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:12:37.298776 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-31f27a91-0b32-4ab5-87b0-3099eeb28454 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 404 len: 111 microversion: 2.1 time: 0.034147 May 16 19:12:37.298776 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 332/681] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:37 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:12:37.304523 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c315ec29-107d-4a8d-9a05-39e4969104c6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '.version_select at 0x7f1e184a5040>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:37.325075 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c315ec29-107d-4a8d-9a05-39e4969104c6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530757485" status: 202 len: 0 microversion: 2.1 time: 0.024432 May 16 19:12:37.325635 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 350/682] 10.222.0.24 () {58 vars in 1220 bytes} [Mon May 16 19:12:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530757485 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:12:37.975617 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0272bae9-8ac3-4d99-ae83-693c1aa5ab2f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Action: 'create', calling method: .version_select at 0x7f1e0be474c0>, body: {"keypair": {"name": "tempest-keypair-1600270445", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/LmqJlPwri0nmib0+aMQIOeoAKg22glQBEqi1okDZ3c2pm6/eZnWeekA4rYNTWHPt+JjJoLLJC1Cv1sBFMuckFP/+Zbk3V/dvLIqwV2z3k3soUIe3mZ/PvHaNAzeiPFg=="}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:37.990183 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-0272bae9-8ac3-4d99-ae83-693c1aa5ab2f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Getting quotas for project dd195af6f92c42a18ed7051eae26dbaa. Resources: {'key_pairs'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:12:37.994203 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-0272bae9-8ac3-4d99-ae83-693c1aa5ab2f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Getting quotas for user 7d3af11e1ffc4ab1a37669f893d2f3be and project dd195af6f92c42a18ed7051eae26dbaa. Resources: {'key_pairs'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:12:37.996227 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a4f023d9-3058-47f6-a058-0b263f887b60 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd21ee13-a791-4160-b7f2-11b738849ebf"}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:37.997356 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a4f023d9-3058-47f6-a058-0b263f887b60 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:38.004233 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a4f023d9-3058-47f6-a058-0b263f887b60 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:38.004661 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a4f023d9-3058-47f6-a058-0b263f887b60 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:38.005399 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a4f023d9-3058-47f6-a058-0b263f887b60 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:38.005861 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a4f023d9-3058-47f6-a058-0b263f887b60 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:38.017758 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0272bae9-8ac3-4d99-ae83-693c1aa5ab2f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046117 May 16 19:12:38.018428 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 333/683] 10.222.0.24 () {60 vars in 1158 bytes} [Mon May 16 19:12:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:12:38.266878 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a4f023d9-3058-47f6-a058-0b263f887b60 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "POST /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274335 May 16 19:12:38.267892 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 351/684] 10.222.0.24 () {60 vars in 1322 bytes} [Mon May 16 19:12:37 2022] POST /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:12:39.335161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ad9fbff2-781a-47f3-b9a1-3742a1b2b387 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2136083329", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9cbd7ed-b011-47eb-8de6-48451d865294"}], "security_groups": [{"name": "tempest-securitygroup--256502696"}], "key_name": "tempest-keypair-1600270445", "user_data": "}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:39.447057 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.network.neutron [None req-ad9fbff2-781a-47f3-b9a1-3742a1b2b387 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] validate_networks() for [('b9cbd7ed-b011-47eb-8de6-48451d865294', None, None, None, None, None)] {{(pid=117275) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:12:39.847954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-ad9fbff2-781a-47f3-b9a1-3742a1b2b387 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Flavor limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:12:39.848368 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-ad9fbff2-781a-47f3-b9a1-3742a1b2b387 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Image limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:12:39.848830 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-ad9fbff2-781a-47f3-b9a1-3742a1b2b387 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Flavor pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:12:39.849235 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-ad9fbff2-781a-47f3-b9a1-3742a1b2b387 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Image pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:12:39.849678 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-ad9fbff2-781a-47f3-b9a1-3742a1b2b387 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:12:39.860780 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ad9fbff2-781a-47f3-b9a1-3742a1b2b387 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:39.861217 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ad9fbff2-781a-47f3-b9a1-3742a1b2b387 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:39.862215 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ad9fbff2-781a-47f3-b9a1-3742a1b2b387 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:39.862645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ad9fbff2-781a-47f3-b9a1-3742a1b2b387 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:39.880013 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-ad9fbff2-781a-47f3-b9a1-3742a1b2b387 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Getting quotas for project dd195af6f92c42a18ed7051eae26dbaa. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:12:39.886508 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-ad9fbff2-781a-47f3-b9a1-3742a1b2b387 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Getting quotas for user 7d3af11e1ffc4ab1a37669f893d2f3be and project dd195af6f92c42a18ed7051eae26dbaa. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:12:39.904257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ad9fbff2-781a-47f3-b9a1-3742a1b2b387 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Going to run 1 instances... {{(pid=117275) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:12:39.907970 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ad9fbff2-781a-47f3-b9a1-3742a1b2b387 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:12:39.957848 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ad9fbff2-781a-47f3-b9a1-3742a1b2b387 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.630011 May 16 19:12:39.958419 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 334/685] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:12:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:12:39.972161 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9533c4c3-c4f1-4ca7-b538-26aba5d9c754 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:39.973115 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9533c4c3-c4f1-4ca7-b538-26aba5d9c754 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:40.032140 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9533c4c3-c4f1-4ca7-b538-26aba5d9c754 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:40.039369 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9533c4c3-c4f1-4ca7-b538-26aba5d9c754 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1242 microversion: 2.1 time: 0.073743 May 16 19:12:40.039945 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 352/686] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:39 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:41.062861 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8351577f-bd6d-4eb6-973b-3f167f473dec tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:41.063969 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8351577f-bd6d-4eb6-973b-3f167f473dec tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:41.075597 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8351577f-bd6d-4eb6-973b-3f167f473dec tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:41.076357 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8351577f-bd6d-4eb6-973b-3f167f473dec tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:41.077711 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8351577f-bd6d-4eb6-973b-3f167f473dec tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:41.078437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8351577f-bd6d-4eb6-973b-3f167f473dec tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:41.141053 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8351577f-bd6d-4eb6-973b-3f167f473dec tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:41.149329 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8351577f-bd6d-4eb6-973b-3f167f473dec tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1294 microversion: 2.1 time: 0.093703 May 16 19:12:41.149951 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 335/687] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:41 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:42.171027 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e5b58b26-8bbf-41cc-8d0f-2237839ade0c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:42.172060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e5b58b26-8bbf-41cc-8d0f-2237839ade0c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:42.184139 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5b58b26-8bbf-41cc-8d0f-2237839ade0c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:42.184903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5b58b26-8bbf-41cc-8d0f-2237839ade0c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:42.186198 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5b58b26-8bbf-41cc-8d0f-2237839ade0c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:42.186916 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e5b58b26-8bbf-41cc-8d0f-2237839ade0c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:42.250681 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e5b58b26-8bbf-41cc-8d0f-2237839ade0c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:42.258674 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e5b58b26-8bbf-41cc-8d0f-2237839ade0c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1302 microversion: 2.1 time: 0.094195 May 16 19:12:42.259233 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 353/688] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:42 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:43.280870 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5ba31359-2389-4602-a185-bb2231c6070f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:43.281852 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5ba31359-2389-4602-a185-bb2231c6070f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:43.293067 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5ba31359-2389-4602-a185-bb2231c6070f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:43.293912 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5ba31359-2389-4602-a185-bb2231c6070f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:43.295141 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5ba31359-2389-4602-a185-bb2231c6070f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:43.295858 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5ba31359-2389-4602-a185-bb2231c6070f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:43.361654 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5ba31359-2389-4602-a185-bb2231c6070f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:43.369687 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5ba31359-2389-4602-a185-bb2231c6070f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1302 microversion: 2.1 time: 0.095517 May 16 19:12:43.370271 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 336/689] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:43 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1302 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:44.386898 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a2992410-933f-40dc-b388-acf2ed444388 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:44.387515 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a2992410-933f-40dc-b388-acf2ed444388 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:44.394112 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a2992410-933f-40dc-b388-acf2ed444388 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:44.394601 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a2992410-933f-40dc-b388-acf2ed444388 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:44.395387 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a2992410-933f-40dc-b388-acf2ed444388 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:44.395825 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a2992410-933f-40dc-b388-acf2ed444388 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:44.462938 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a2992410-933f-40dc-b388-acf2ed444388 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:44.470567 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a2992410-933f-40dc-b388-acf2ed444388 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1300 microversion: 2.1 time: 0.087598 May 16 19:12:44.471143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 354/690] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:44 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:45.469496 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-3a56c147-f08b-4ec9-9a86-1836b4de8a9f req-752ce3a3-1452-434d-b533-13a12fc1df4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7436d70f-ee98-42cc-95ff-4aa094d149c8", "tag": "34e977f1-14f8-42d4-a048-80b967122723"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:45.479840 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-3a56c147-f08b-4ec9-9a86-1836b4de8a9f req-752ce3a3-1452-434d-b533-13a12fc1df4f service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:45.480392 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-3a56c147-f08b-4ec9-9a86-1836b4de8a9f req-752ce3a3-1452-434d-b533-13a12fc1df4f service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:45.492393 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-3a56c147-f08b-4ec9-9a86-1836b4de8a9f req-752ce3a3-1452-434d-b533-13a12fc1df4f service nova] Creating event network-changed:34e977f1-14f8-42d4-a048-80b967122723 for instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 on hv-cinder-76606 May 16 19:12:45.493309 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-604f0599-8a26-4a51-9ee3-efe6e3c18ad9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:45.496923 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-604f0599-8a26-4a51-9ee3-efe6e3c18ad9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:45.497182 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-3a56c147-f08b-4ec9-9a86-1836b4de8a9f req-752ce3a3-1452-434d-b533-13a12fc1df4f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032272 May 16 19:12:45.498128 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 337/691] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:12:45.506357 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-604f0599-8a26-4a51-9ee3-efe6e3c18ad9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:45.506763 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-604f0599-8a26-4a51-9ee3-efe6e3c18ad9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:45.507557 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-604f0599-8a26-4a51-9ee3-efe6e3c18ad9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:45.507979 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-604f0599-8a26-4a51-9ee3-efe6e3c18ad9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:45.655146 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-604f0599-8a26-4a51-9ee3-efe6e3c18ad9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:45.663374 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-604f0599-8a26-4a51-9ee3-efe6e3c18ad9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1367 microversion: 2.1 time: 0.179301 May 16 19:12:45.664070 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 355/692] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:45 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:46.682481 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d36df5a9-d87c-417d-83f0-9444a7145496 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:46.683240 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d36df5a9-d87c-417d-83f0-9444a7145496 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:46.689981 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d36df5a9-d87c-417d-83f0-9444a7145496 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:46.690426 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d36df5a9-d87c-417d-83f0-9444a7145496 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:46.691257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d36df5a9-d87c-417d-83f0-9444a7145496 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:46.691686 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d36df5a9-d87c-417d-83f0-9444a7145496 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:46.820775 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d36df5a9-d87c-417d-83f0-9444a7145496 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:46.828248 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d36df5a9-d87c-417d-83f0-9444a7145496 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1367 microversion: 2.1 time: 0.150725 May 16 19:12:46.828819 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 338/693] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:46 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:47.845564 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-13d10b8b-ac1a-456f-99b1-73395879e077 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:47.846209 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-13d10b8b-ac1a-456f-99b1-73395879e077 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:47.852987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-13d10b8b-ac1a-456f-99b1-73395879e077 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:47.853430 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-13d10b8b-ac1a-456f-99b1-73395879e077 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:47.854232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-13d10b8b-ac1a-456f-99b1-73395879e077 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:47.854665 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-13d10b8b-ac1a-456f-99b1-73395879e077 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:47.988248 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-13d10b8b-ac1a-456f-99b1-73395879e077 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:47.996034 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-13d10b8b-ac1a-456f-99b1-73395879e077 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1367 microversion: 2.1 time: 0.154438 May 16 19:12:47.996598 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 356/694] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:47 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:48.431268 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-dc15c500-5878-4dfa-a036-e2e398ad5769 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:48.431809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-dc15c500-5878-4dfa-a036-e2e398ad5769 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:48.438593 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dc15c500-5878-4dfa-a036-e2e398ad5769 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:48.439037 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dc15c500-5878-4dfa-a036-e2e398ad5769 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:48.439819 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dc15c500-5878-4dfa-a036-e2e398ad5769 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:48.440252 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dc15c500-5878-4dfa-a036-e2e398ad5769 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:48.474129 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-dc15c500-5878-4dfa-a036-e2e398ad5769 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-volume_attachments/ae7a181b-587c-4398-92d1-0f8b3cd8b7df" status: 200 len: 194 microversion: 2.20 time: 0.046916 May 16 19:12:48.474910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 339/695] 10.222.0.24 () {60 vars in 1453 bytes} [Mon May 16 19:12:48 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-volume_attachments/ae7a181b-587c-4398-92d1-0f8b3cd8b7df => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:12:48.539599 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-cd665298-f710-4b67-9d52-f5ad760c69f0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:48.540088 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-cd665298-f710-4b67-9d52-f5ad760c69f0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:48.546075 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cd665298-f710-4b67-9d52-f5ad760c69f0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:48.546520 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cd665298-f710-4b67-9d52-f5ad760c69f0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:48.547306 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cd665298-f710-4b67-9d52-f5ad760c69f0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:48.547733 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cd665298-f710-4b67-9d52-f5ad760c69f0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:48.629873 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-cd665298-f710-4b67-9d52-f5ad760c69f0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lazy-loading 'services' on Instance uuid d5b53695-b6e7-4e7b-b6d5-539770d20f41 {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:12:48.708243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-cd665298-f710-4b67-9d52-f5ad760c69f0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-volume_attachments/ae7a181b-587c-4398-92d1-0f8b3cd8b7df" status: 202 len: 0 microversion: 2.20 time: 0.172386 May 16 19:12:48.708832 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 357/696] 10.222.0.24 () {60 vars in 1456 bytes} [Mon May 16 19:12:48 2022] DELETE /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-volume_attachments/ae7a181b-587c-4398-92d1-0f8b3cd8b7df => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 19:12:48.717366 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f5b476b4-2ed9-4083-b656-0d2f306035bf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:48.718363 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f5b476b4-2ed9-4083-b656-0d2f306035bf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:48.724345 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f5b476b4-2ed9-4083-b656-0d2f306035bf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:48.724793 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f5b476b4-2ed9-4083-b656-0d2f306035bf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:48.725579 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f5b476b4-2ed9-4083-b656-0d2f306035bf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:48.726016 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f5b476b4-2ed9-4083-b656-0d2f306035bf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:48.756361 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f5b476b4-2ed9-4083-b656-0d2f306035bf tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043000 May 16 19:12:48.756939 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 340/697] 10.222.0.24 () {60 vars in 1342 bytes} [Mon May 16 19:12:48 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:12:49.015707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-195b6ad2-b4b7-4552-bd11-50a27d061480 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:49.017002 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-195b6ad2-b4b7-4552-bd11-50a27d061480 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:49.027769 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-195b6ad2-b4b7-4552-bd11-50a27d061480 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:49.028416 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-195b6ad2-b4b7-4552-bd11-50a27d061480 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:49.029820 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-195b6ad2-b4b7-4552-bd11-50a27d061480 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:49.030551 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-195b6ad2-b4b7-4552-bd11-50a27d061480 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:49.172393 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-195b6ad2-b4b7-4552-bd11-50a27d061480 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:49.180414 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-195b6ad2-b4b7-4552-bd11-50a27d061480 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1367 microversion: 2.1 time: 0.170834 May 16 19:12:49.180983 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 358/698] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:49 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:49.773449 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-2b7e6f56-38f6-4951-bd10-70a934533b5e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:49.775069 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-2b7e6f56-38f6-4951-bd10-70a934533b5e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:49.785445 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2b7e6f56-38f6-4951-bd10-70a934533b5e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:49.785930 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2b7e6f56-38f6-4951-bd10-70a934533b5e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:49.786698 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2b7e6f56-38f6-4951-bd10-70a934533b5e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:49.787130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2b7e6f56-38f6-4951-bd10-70a934533b5e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:49.819653 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-2b7e6f56-38f6-4951-bd10-70a934533b5e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053340 May 16 19:12:49.820417 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 341/699] 10.222.0.24 () {60 vars in 1342 bytes} [Mon May 16 19:12:49 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:12:50.198167 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d013377a-3be0-4381-9fa7-a9d30852616b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:50.198839 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d013377a-3be0-4381-9fa7-a9d30852616b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:50.206046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d013377a-3be0-4381-9fa7-a9d30852616b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:50.206590 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d013377a-3be0-4381-9fa7-a9d30852616b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:50.207367 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d013377a-3be0-4381-9fa7-a9d30852616b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:50.207801 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d013377a-3be0-4381-9fa7-a9d30852616b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:50.341805 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d013377a-3be0-4381-9fa7-a9d30852616b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:50.349375 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d013377a-3be0-4381-9fa7-a9d30852616b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1367 microversion: 2.1 time: 0.155484 May 16 19:12:50.350008 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 359/700] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:50 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:50.831748 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f18d5d75-c06b-4bce-bf1e-e5832da91400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:50.832681 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f18d5d75-c06b-4bce-bf1e-e5832da91400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:50.839295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f18d5d75-c06b-4bce-bf1e-e5832da91400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:50.839748 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f18d5d75-c06b-4bce-bf1e-e5832da91400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:50.840518 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f18d5d75-c06b-4bce-bf1e-e5832da91400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:50.840951 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f18d5d75-c06b-4bce-bf1e-e5832da91400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:50.870044 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f18d5d75-c06b-4bce-bf1e-e5832da91400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042321 May 16 19:12:50.870620 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 342/701] 10.222.0.24 () {60 vars in 1342 bytes} [Mon May 16 19:12:50 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:12:51.376056 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-22304116-514c-4569-817b-6f13c36cb316 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:51.376924 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-22304116-514c-4569-817b-6f13c36cb316 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:51.384368 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-22304116-514c-4569-817b-6f13c36cb316 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:51.384821 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-22304116-514c-4569-817b-6f13c36cb316 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:51.385618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-22304116-514c-4569-817b-6f13c36cb316 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:51.386056 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-22304116-514c-4569-817b-6f13c36cb316 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:51.557273 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-22304116-514c-4569-817b-6f13c36cb316 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:51.577392 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-22304116-514c-4569-817b-6f13c36cb316 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1367 microversion: 2.1 time: 0.207960 May 16 19:12:51.578145 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 360/702] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:51 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:51.882290 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e85fe0d6-173d-4c0e-888d-7e00f24b50ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:51.883138 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e85fe0d6-173d-4c0e-888d-7e00f24b50ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:51.889637 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e85fe0d6-173d-4c0e-888d-7e00f24b50ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:51.890095 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e85fe0d6-173d-4c0e-888d-7e00f24b50ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:51.890873 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e85fe0d6-173d-4c0e-888d-7e00f24b50ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:51.891320 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e85fe0d6-173d-4c0e-888d-7e00f24b50ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:51.922751 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e85fe0d6-173d-4c0e-888d-7e00f24b50ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044745 May 16 19:12:51.923353 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 343/703] 10.222.0.24 () {60 vars in 1342 bytes} [Mon May 16 19:12:51 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:12:52.151221 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d58ad97a-27e3-4066-97c1-44bf756270df tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:52.152299 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d58ad97a-27e3-4066-97c1-44bf756270df tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:52.165046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d58ad97a-27e3-4066-97c1-44bf756270df tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:52.165697 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d58ad97a-27e3-4066-97c1-44bf756270df tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:52.166484 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d58ad97a-27e3-4066-97c1-44bf756270df tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:52.166953 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d58ad97a-27e3-4066-97c1-44bf756270df tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:52.191208 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-d58ad97a-27e3-4066-97c1-44bf756270df tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lazy-loading 'flavor' on Instance uuid eeb4d6c5-966a-44b0-a092-602b55ec665c {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:12:52.323455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d58ad97a-27e3-4066-97c1-44bf756270df tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "POST /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/action" status: 200 len: 32 microversion: 2.1 time: 0.176568 May 16 19:12:52.324168 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 361/704] 10.222.0.24 () {60 vars in 1277 bytes} [Mon May 16 19:12:52 2022] POST /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/action => generated 32 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 19:12:52.333455 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-bb9e590c-3b29-4704-9cc6-eaf1109d20e7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:52.334121 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-bb9e590c-3b29-4704-9cc6-eaf1109d20e7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:52.340665 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bb9e590c-3b29-4704-9cc6-eaf1109d20e7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:52.341100 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bb9e590c-3b29-4704-9cc6-eaf1109d20e7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:52.342040 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bb9e590c-3b29-4704-9cc6-eaf1109d20e7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:52.342464 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bb9e590c-3b29-4704-9cc6-eaf1109d20e7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:52.546416 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-bb9e590c-3b29-4704-9cc6-eaf1109d20e7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:52.555724 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-bb9e590c-3b29-4704-9cc6-eaf1109d20e7 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.226274 May 16 19:12:52.556300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 344/705] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:52 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:52.595776 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ba98800f-bb79-475a-8935-3baa0d0df7a4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:52.596732 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ba98800f-bb79-475a-8935-3baa0d0df7a4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:52.603312 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ba98800f-bb79-475a-8935-3baa0d0df7a4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:52.603746 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ba98800f-bb79-475a-8935-3baa0d0df7a4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:52.604504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ba98800f-bb79-475a-8935-3baa0d0df7a4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:52.604932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ba98800f-bb79-475a-8935-3baa0d0df7a4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:52.684422 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b1ca49b6-b53b-44e9-9fbe-2d07186b4767 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:52.685166 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b1ca49b6-b53b-44e9-9fbe-2d07186b4767 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:52.691323 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b1ca49b6-b53b-44e9-9fbe-2d07186b4767 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:52.692116 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b1ca49b6-b53b-44e9-9fbe-2d07186b4767 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:52.692539 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b1ca49b6-b53b-44e9-9fbe-2d07186b4767 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:52.693007 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b1ca49b6-b53b-44e9-9fbe-2d07186b4767 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:52.743485 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ba98800f-bb79-475a-8935-3baa0d0df7a4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:52.752229 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ba98800f-bb79-475a-8935-3baa0d0df7a4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1367 microversion: 2.1 time: 0.161150 May 16 19:12:52.752899 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 362/706] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:52 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:52.817432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.objects.instance [None req-b1ca49b6-b53b-44e9-9fbe-2d07186b4767 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lazy-loading 'services' on Instance uuid 29c82423-6014-4a34-b5fd-2386a32d7a9f {{(pid=117275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:12:52.935610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d53b5d60-8e74-48d9-8223-3ff03f18cd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:52.936829 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d53b5d60-8e74-48d9-8223-3ff03f18cd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:52.944136 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d53b5d60-8e74-48d9-8223-3ff03f18cd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:52.944887 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d53b5d60-8e74-48d9-8223-3ff03f18cd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:52.945693 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d53b5d60-8e74-48d9-8223-3ff03f18cd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:52.946129 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d53b5d60-8e74-48d9-8223-3ff03f18cd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:52.951417 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b1ca49b6-b53b-44e9-9fbe-2d07186b4767 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "DELETE /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f/os-volume_attachments/bee6fb34-e3f2-4c99-bfab-f074e5e004d4" status: 202 len: 0 microversion: 2.1 time: 0.270618 May 16 19:12:52.952458 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 345/707] 10.222.0.24 () {58 vars in 1415 bytes} [Mon May 16 19:12:52 2022] DELETE /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f/os-volume_attachments/bee6fb34-e3f2-4c99-bfab-f074e5e004d4 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 19:12:52.981463 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d53b5d60-8e74-48d9-8223-3ff03f18cd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050516 May 16 19:12:52.985716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 363/708] 10.222.0.24 () {60 vars in 1342 bytes} [Mon May 16 19:12:52 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:53.033736 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-9e32e63e-7911-47f6-a84a-360124aad703 req-4900f74d-ff2c-404c-95f6-750fd972540b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7436d70f-ee98-42cc-95ff-4aa094d149c8", "name": "network-vif-plugged", "status": "completed", "tag": "34e977f1-14f8-42d4-a048-80b967122723"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:53.046388 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9e4500a6-508e-40b4-8f4f-7b1e0f1b526e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:53.048238 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9e4500a6-508e-40b4-8f4f-7b1e0f1b526e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:53.053387 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9e4500a6-508e-40b4-8f4f-7b1e0f1b526e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:53.053865 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9e4500a6-508e-40b4-8f4f-7b1e0f1b526e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:53.054324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-9e32e63e-7911-47f6-a84a-360124aad703 req-4900f74d-ff2c-404c-95f6-750fd972540b service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:53.054794 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9e4500a6-508e-40b4-8f4f-7b1e0f1b526e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:53.055118 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-9e32e63e-7911-47f6-a84a-360124aad703 req-4900f74d-ff2c-404c-95f6-750fd972540b service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:53.055240 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9e4500a6-508e-40b4-8f4f-7b1e0f1b526e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:53.068461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-9e32e63e-7911-47f6-a84a-360124aad703 req-4900f74d-ff2c-404c-95f6-750fd972540b service nova] Creating event network-vif-plugged:34e977f1-14f8-42d4-a048-80b967122723 for instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 on hv-cinder-76606 May 16 19:12:53.074433 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-9e32e63e-7911-47f6-a84a-360124aad703 req-4900f74d-ff2c-404c-95f6-750fd972540b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044643 May 16 19:12:53.075902 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 346/709] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:12:53.083020 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9e4500a6-508e-40b4-8f4f-7b1e0f1b526e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Going to try to terminate instance {{(pid=117274) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:12:53.158545 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9e4500a6-508e-40b4-8f4f-7b1e0f1b526e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 204 len: 0 microversion: 2.20 time: 0.116744 May 16 19:12:53.159139 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 364/710] 10.222.0.24 () {60 vars in 1279 bytes} [Mon May 16 19:12:53 2022] DELETE /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 19:12:53.168080 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0c05055d-cf1b-497e-82cd-f2fe4896d24d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:53.168772 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0c05055d-cf1b-497e-82cd-f2fe4896d24d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:53.175393 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0c05055d-cf1b-497e-82cd-f2fe4896d24d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:53.175831 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0c05055d-cf1b-497e-82cd-f2fe4896d24d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:53.176592 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0c05055d-cf1b-497e-82cd-f2fe4896d24d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:53.177008 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0c05055d-cf1b-497e-82cd-f2fe4896d24d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:53.324167 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0c05055d-cf1b-497e-82cd-f2fe4896d24d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:53.332453 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0c05055d-cf1b-497e-82cd-f2fe4896d24d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:53.333990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0c05055d-cf1b-497e-82cd-f2fe4896d24d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:53.335139 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0c05055d-cf1b-497e-82cd-f2fe4896d24d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1724 microversion: 2.20 time: 0.171444 May 16 19:12:53.335745 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 347/711] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:12:53 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:12:53.574863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0f640980-4e40-4893-b803-113f749b82d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:53.575580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0f640980-4e40-4893-b803-113f749b82d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:53.581904 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0f640980-4e40-4893-b803-113f749b82d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:53.582346 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0f640980-4e40-4893-b803-113f749b82d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:53.583173 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0f640980-4e40-4893-b803-113f749b82d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:53.583607 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0f640980-4e40-4893-b803-113f749b82d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:53.716635 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0f640980-4e40-4893-b803-113f749b82d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:53.729245 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0f640980-4e40-4893-b803-113f749b82d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.160154 May 16 19:12:53.730052 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 365/712] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:53 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:53.771412 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d2883ee5-e788-4b74-9a45-5ddeb779acce tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:53.772355 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d2883ee5-e788-4b74-9a45-5ddeb779acce tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:53.778688 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d2883ee5-e788-4b74-9a45-5ddeb779acce tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:53.779068 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d2883ee5-e788-4b74-9a45-5ddeb779acce tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:53.779831 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d2883ee5-e788-4b74-9a45-5ddeb779acce tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:53.780265 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d2883ee5-e788-4b74-9a45-5ddeb779acce tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:53.909423 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d2883ee5-e788-4b74-9a45-5ddeb779acce tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:53.917695 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d2883ee5-e788-4b74-9a45-5ddeb779acce tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1367 microversion: 2.1 time: 0.151193 May 16 19:12:53.918272 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 348/713] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:53 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:54.358079 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ed72a4bc-7658-4de4-ba33-c73f03fadc72 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:54.358977 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ed72a4bc-7658-4de4-ba33-c73f03fadc72 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:54.369706 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ed72a4bc-7658-4de4-ba33-c73f03fadc72 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:54.370431 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ed72a4bc-7658-4de4-ba33-c73f03fadc72 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:54.371698 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ed72a4bc-7658-4de4-ba33-c73f03fadc72 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:54.372577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ed72a4bc-7658-4de4-ba33-c73f03fadc72 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:54.512858 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ed72a4bc-7658-4de4-ba33-c73f03fadc72 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:54.523596 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ed72a4bc-7658-4de4-ba33-c73f03fadc72 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:54.525075 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ed72a4bc-7658-4de4-ba33-c73f03fadc72 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:54.526284 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ed72a4bc-7658-4de4-ba33-c73f03fadc72 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1724 microversion: 2.20 time: 0.175007 May 16 19:12:54.526843 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 366/714] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:12:54 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:12:54.754011 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-7b452d45-ef6e-44a9-845e-1a1874c1ef8c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:54.755048 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-7b452d45-ef6e-44a9-845e-1a1874c1ef8c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:54.765478 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7b452d45-ef6e-44a9-845e-1a1874c1ef8c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:54.766282 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7b452d45-ef6e-44a9-845e-1a1874c1ef8c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:54.767550 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7b452d45-ef6e-44a9-845e-1a1874c1ef8c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:54.768275 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7b452d45-ef6e-44a9-845e-1a1874c1ef8c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:54.909477 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-7b452d45-ef6e-44a9-845e-1a1874c1ef8c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:54.917956 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-7b452d45-ef6e-44a9-845e-1a1874c1ef8c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.170568 May 16 19:12:54.918526 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 349/715] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:54 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:54.934872 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9ba45eee-ac51-4a1f-8e27-039ade3aff3e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:54.935484 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9ba45eee-ac51-4a1f-8e27-039ade3aff3e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:54.942157 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9ba45eee-ac51-4a1f-8e27-039ade3aff3e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:54.942597 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9ba45eee-ac51-4a1f-8e27-039ade3aff3e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:54.943366 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9ba45eee-ac51-4a1f-8e27-039ade3aff3e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:54.943795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9ba45eee-ac51-4a1f-8e27-039ade3aff3e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:55.093325 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9ba45eee-ac51-4a1f-8e27-039ade3aff3e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:55.101299 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9ba45eee-ac51-4a1f-8e27-039ade3aff3e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1367 microversion: 2.1 time: 0.170381 May 16 19:12:55.101933 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 367/716] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:54 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:55.550389 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-92dcfc55-ade7-4c74-a2ec-1fdbd6377261 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:55.550987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-92dcfc55-ade7-4c74-a2ec-1fdbd6377261 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:55.557569 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-92dcfc55-ade7-4c74-a2ec-1fdbd6377261 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:55.558016 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-92dcfc55-ade7-4c74-a2ec-1fdbd6377261 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:55.558771 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-92dcfc55-ade7-4c74-a2ec-1fdbd6377261 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:55.559194 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-92dcfc55-ade7-4c74-a2ec-1fdbd6377261 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:55.790810 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-92dcfc55-ade7-4c74-a2ec-1fdbd6377261 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:55.799234 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-92dcfc55-ade7-4c74-a2ec-1fdbd6377261 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:55.800730 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-92dcfc55-ade7-4c74-a2ec-1fdbd6377261 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:55.802195 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-92dcfc55-ade7-4c74-a2ec-1fdbd6377261 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1724 microversion: 2.20 time: 0.255696 May 16 19:12:55.803166 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 350/717] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:12:55 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:12:55.935327 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ddf975c7-1837-4702-818f-5929bb379c6f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:55.935944 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ddf975c7-1837-4702-818f-5929bb379c6f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:55.943280 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ddf975c7-1837-4702-818f-5929bb379c6f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:55.943780 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ddf975c7-1837-4702-818f-5929bb379c6f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:55.944739 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ddf975c7-1837-4702-818f-5929bb379c6f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:55.945173 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ddf975c7-1837-4702-818f-5929bb379c6f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:56.079580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ddf975c7-1837-4702-818f-5929bb379c6f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:56.087876 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ddf975c7-1837-4702-818f-5929bb379c6f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.156632 May 16 19:12:56.088502 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 368/718] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:55 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:56.119335 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-29ff859e-2999-4ba1-af54-bd303e8c8ed5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:56.119946 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-29ff859e-2999-4ba1-af54-bd303e8c8ed5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:56.130480 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-29ff859e-2999-4ba1-af54-bd303e8c8ed5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:56.130988 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-29ff859e-2999-4ba1-af54-bd303e8c8ed5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:56.135373 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-29ff859e-2999-4ba1-af54-bd303e8c8ed5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:56.135830 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-29ff859e-2999-4ba1-af54-bd303e8c8ed5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:56.193983 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c8c3b3cc-d449-4606-88a0-0f8258a94267 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:56.194482 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c8c3b3cc-d449-4606-88a0-0f8258a94267 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:56.200447 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c8c3b3cc-d449-4606-88a0-0f8258a94267 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:56.200901 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c8c3b3cc-d449-4606-88a0-0f8258a94267 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:56.201719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c8c3b3cc-d449-4606-88a0-0f8258a94267 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:56.202157 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c8c3b3cc-d449-4606-88a0-0f8258a94267 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:56.226737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c8c3b3cc-d449-4606-88a0-0f8258a94267 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Going to try to terminate instance {{(pid=117274) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:12:56.305099 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c8c3b3cc-d449-4606-88a0-0f8258a94267 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "DELETE /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 204 len: 0 microversion: 2.1 time: 0.114674 May 16 19:12:56.305840 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 369/719] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:12:56 2022] DELETE /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 19:12:56.315620 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-55466c63-dd0a-4056-9340-dbf2a758f7e7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:56.321077 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-55466c63-dd0a-4056-9340-dbf2a758f7e7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:56.330559 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-55466c63-dd0a-4056-9340-dbf2a758f7e7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:56.331154 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-55466c63-dd0a-4056-9340-dbf2a758f7e7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:56.332577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-55466c63-dd0a-4056-9340-dbf2a758f7e7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:56.333013 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-55466c63-dd0a-4056-9340-dbf2a758f7e7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:56.344984 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-29ff859e-2999-4ba1-af54-bd303e8c8ed5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:56.353342 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-29ff859e-2999-4ba1-af54-bd303e8c8ed5 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1367 microversion: 2.1 time: 0.237864 May 16 19:12:56.354103 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 351/720] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:56 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:56.467438 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-55466c63-dd0a-4056-9340-dbf2a758f7e7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:56.475085 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-55466c63-dd0a-4056-9340-dbf2a758f7e7 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 200 len: 1515 microversion: 2.1 time: 0.164650 May 16 19:12:56.475663 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 370/721] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:56 2022] GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:56.598687 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-01831e4f-d5da-4aeb-bfcc-022c440b031b req-0cfbd921-5a22-4fc8-be9a-7480b05e3fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b53695-b6e7-4e7b-b6d5-539770d20f41", "name": "network-vif-deleted", "tag": "5ed69d31-3be1-4fa7-a495-fce15a7677cb"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:12:56.606850 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-01831e4f-d5da-4aeb-bfcc-022c440b031b req-0cfbd921-5a22-4fc8-be9a-7480b05e3fa1 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:56.607396 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-01831e4f-d5da-4aeb-bfcc-022c440b031b req-0cfbd921-5a22-4fc8-be9a-7480b05e3fa1 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:56.618511 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-01831e4f-d5da-4aeb-bfcc-022c440b031b req-0cfbd921-5a22-4fc8-be9a-7480b05e3fa1 service nova] Creating event network-vif-deleted:5ed69d31-3be1-4fa7-a495-fce15a7677cb for instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 on hv-cinder-76606 May 16 19:12:56.623528 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-01831e4f-d5da-4aeb-bfcc-022c440b031b req-0cfbd921-5a22-4fc8-be9a-7480b05e3fa1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028641 May 16 19:12:56.624113 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 352/722] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:12:56.823447 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a9259e00-18fe-4362-a579-202e0d3bc205 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:56.823973 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a9259e00-18fe-4362-a579-202e0d3bc205 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:56.830076 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a9259e00-18fe-4362-a579-202e0d3bc205 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:56.830528 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a9259e00-18fe-4362-a579-202e0d3bc205 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:56.831307 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a9259e00-18fe-4362-a579-202e0d3bc205 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:56.831740 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a9259e00-18fe-4362-a579-202e0d3bc205 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:56.893503 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a9259e00-18fe-4362-a579-202e0d3bc205 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:56.902142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a9259e00-18fe-4362-a579-202e0d3bc205 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:56.903607 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a9259e00-18fe-4362-a579-202e0d3bc205 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:56.904757 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a9259e00-18fe-4362-a579-202e0d3bc205 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1367 microversion: 2.20 time: 0.085558 May 16 19:12:56.905572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 371/723] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:12:56 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:12:57.106036 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-24081ade-86bb-4311-919e-66fbb971a3e0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:57.106745 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-24081ade-86bb-4311-919e-66fbb971a3e0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:57.113557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-24081ade-86bb-4311-919e-66fbb971a3e0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:57.114007 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-24081ade-86bb-4311-919e-66fbb971a3e0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:57.114772 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-24081ade-86bb-4311-919e-66fbb971a3e0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:57.115229 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-24081ade-86bb-4311-919e-66fbb971a3e0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:57.251019 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-24081ade-86bb-4311-919e-66fbb971a3e0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:57.259660 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-24081ade-86bb-4311-919e-66fbb971a3e0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.157851 May 16 19:12:57.260312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 353/724] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:57 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:57.371032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-87217806-b8c7-4bcd-b94b-a01f4ccdbc3c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:57.371550 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-87217806-b8c7-4bcd-b94b-a01f4ccdbc3c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:57.378449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-87217806-b8c7-4bcd-b94b-a01f4ccdbc3c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:57.378888 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-87217806-b8c7-4bcd-b94b-a01f4ccdbc3c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:57.379672 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-87217806-b8c7-4bcd-b94b-a01f4ccdbc3c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:57.380104 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-87217806-b8c7-4bcd-b94b-a01f4ccdbc3c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:57.491891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b616d685-46ee-4e8b-9244-5a2540757864 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:57.492833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b616d685-46ee-4e8b-9244-5a2540757864 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:57.499100 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b616d685-46ee-4e8b-9244-5a2540757864 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:57.499660 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b616d685-46ee-4e8b-9244-5a2540757864 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:57.500529 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b616d685-46ee-4e8b-9244-5a2540757864 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:57.501053 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b616d685-46ee-4e8b-9244-5a2540757864 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:57.512789 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-87217806-b8c7-4bcd-b94b-a01f4ccdbc3c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:57.523374 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-87217806-b8c7-4bcd-b94b-a01f4ccdbc3c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1367 microversion: 2.1 time: 0.155816 May 16 19:12:57.529294 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 372/725] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:57 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:57.647400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b616d685-46ee-4e8b-9244-5a2540757864 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:57.655549 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b616d685-46ee-4e8b-9244-5a2540757864 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 200 len: 1515 microversion: 2.1 time: 0.167603 May 16 19:12:57.656130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 354/726] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:57 2022] GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:57.926989 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-02f4f029-8162-43b4-9d41-1d6719dd65a5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:57.928001 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-02f4f029-8162-43b4-9d41-1d6719dd65a5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:57.938566 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-02f4f029-8162-43b4-9d41-1d6719dd65a5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:57.939323 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-02f4f029-8162-43b4-9d41-1d6719dd65a5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:57.940604 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-02f4f029-8162-43b4-9d41-1d6719dd65a5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:57.941325 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-02f4f029-8162-43b4-9d41-1d6719dd65a5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:58.003113 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-02f4f029-8162-43b4-9d41-1d6719dd65a5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:58.011528 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-02f4f029-8162-43b4-9d41-1d6719dd65a5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:58.012988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-02f4f029-8162-43b4-9d41-1d6719dd65a5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:58.014185 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-02f4f029-8162-43b4-9d41-1d6719dd65a5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1367 microversion: 2.20 time: 0.093935 May 16 19:12:58.014753 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 373/727] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:12:57 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:12:58.282200 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1bfdb221-6ae8-4087-afe7-da8ecd1b6640 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:58.283049 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1bfdb221-6ae8-4087-afe7-da8ecd1b6640 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:58.293934 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1bfdb221-6ae8-4087-afe7-da8ecd1b6640 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:58.294679 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1bfdb221-6ae8-4087-afe7-da8ecd1b6640 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:58.295946 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1bfdb221-6ae8-4087-afe7-da8ecd1b6640 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:58.296665 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1bfdb221-6ae8-4087-afe7-da8ecd1b6640 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:58.437992 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1bfdb221-6ae8-4087-afe7-da8ecd1b6640 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:58.449493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1bfdb221-6ae8-4087-afe7-da8ecd1b6640 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.173827 May 16 19:12:58.450340 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 355/728] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:58 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:58.541710 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-cd3948ba-cf7a-43c7-bfd7-ca6a3f92089a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:58.542256 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-cd3948ba-cf7a-43c7-bfd7-ca6a3f92089a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:58.550598 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cd3948ba-cf7a-43c7-bfd7-ca6a3f92089a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:58.551160 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cd3948ba-cf7a-43c7-bfd7-ca6a3f92089a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:58.552832 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cd3948ba-cf7a-43c7-bfd7-ca6a3f92089a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:58.553427 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cd3948ba-cf7a-43c7-bfd7-ca6a3f92089a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:58.672473 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e7aba4f8-fbd2-40dc-aff5-d2952f62315e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:58.673112 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e7aba4f8-fbd2-40dc-aff5-d2952f62315e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:58.679661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e7aba4f8-fbd2-40dc-aff5-d2952f62315e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:58.680127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e7aba4f8-fbd2-40dc-aff5-d2952f62315e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:58.680911 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e7aba4f8-fbd2-40dc-aff5-d2952f62315e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:58.681343 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e7aba4f8-fbd2-40dc-aff5-d2952f62315e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:58.689230 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-cd3948ba-cf7a-43c7-bfd7-ca6a3f92089a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:58.696667 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-cd3948ba-cf7a-43c7-bfd7-ca6a3f92089a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1367 microversion: 2.1 time: 0.159383 May 16 19:12:58.697253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 374/729] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:58 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:58.809646 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e7aba4f8-fbd2-40dc-aff5-d2952f62315e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:58.818253 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e7aba4f8-fbd2-40dc-aff5-d2952f62315e tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 200 len: 1515 microversion: 2.1 time: 0.149778 May 16 19:12:58.818806 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 356/730] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:58 2022] GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:59.036558 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-563d8005-bdc9-4349-b372-0c3e50022d08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:59.037652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-563d8005-bdc9-4349-b372-0c3e50022d08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:59.047887 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-563d8005-bdc9-4349-b372-0c3e50022d08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:59.048588 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-563d8005-bdc9-4349-b372-0c3e50022d08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:59.049989 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-563d8005-bdc9-4349-b372-0c3e50022d08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:59.050709 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-563d8005-bdc9-4349-b372-0c3e50022d08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:59.080627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-563d8005-bdc9-4349-b372-0c3e50022d08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:59.080970 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-563d8005-bdc9-4349-b372-0c3e50022d08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:59.081422 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-563d8005-bdc9-4349-b372-0c3e50022d08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lazy-loading 'fault' on Instance uuid d5b53695-b6e7-4e7b-b6d5-539770d20f41 {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:12:59.125805 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-563d8005-bdc9-4349-b372-0c3e50022d08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:59.134071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-563d8005-bdc9-4349-b372-0c3e50022d08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:59.135590 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-563d8005-bdc9-4349-b372-0c3e50022d08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:59.136759 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-563d8005-bdc9-4349-b372-0c3e50022d08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 200 len: 1372 microversion: 2.20 time: 0.106951 May 16 19:12:59.137315 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 375/731] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:12:59 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:12:59.469563 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e86aae24-dc0e-4a8e-8048-3fca537e1482 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:59.470263 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e86aae24-dc0e-4a8e-8048-3fca537e1482 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:59.478304 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e86aae24-dc0e-4a8e-8048-3fca537e1482 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:59.478738 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e86aae24-dc0e-4a8e-8048-3fca537e1482 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:59.480165 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e86aae24-dc0e-4a8e-8048-3fca537e1482 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:59.480597 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e86aae24-dc0e-4a8e-8048-3fca537e1482 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:59.615617 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e86aae24-dc0e-4a8e-8048-3fca537e1482 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:59.623970 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e86aae24-dc0e-4a8e-8048-3fca537e1482 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.158431 May 16 19:12:59.624557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 357/732] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:59 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:59.717900 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a069fa7a-1e78-4aa0-acf3-f768275c6424 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:59.718972 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a069fa7a-1e78-4aa0-acf3-f768275c6424 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:59.729825 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a069fa7a-1e78-4aa0-acf3-f768275c6424 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:59.730467 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a069fa7a-1e78-4aa0-acf3-f768275c6424 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:59.732435 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a069fa7a-1e78-4aa0-acf3-f768275c6424 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:59.733737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a069fa7a-1e78-4aa0-acf3-f768275c6424 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:59.837123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-dc9fe023-7e59-4112-980e-a7f2a1000229 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:59.837828 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-dc9fe023-7e59-4112-980e-a7f2a1000229 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:59.844569 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dc9fe023-7e59-4112-980e-a7f2a1000229 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:59.845250 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dc9fe023-7e59-4112-980e-a7f2a1000229 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:59.846305 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dc9fe023-7e59-4112-980e-a7f2a1000229 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:59.846899 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dc9fe023-7e59-4112-980e-a7f2a1000229 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:59.869910 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a069fa7a-1e78-4aa0-acf3-f768275c6424 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:12:59.879218 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a069fa7a-1e78-4aa0-acf3-f768275c6424 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1556 microversion: 2.1 time: 0.167873 May 16 19:12:59.879808 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 376/733] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:59 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:12:59.895515 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-66e52837-75d6-4681-9b41-dd1536bdac37 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:12:59.896785 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-66e52837-75d6-4681-9b41-dd1536bdac37 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:12:59.902954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-66e52837-75d6-4681-9b41-dd1536bdac37 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:59.903668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-66e52837-75d6-4681-9b41-dd1536bdac37 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:59.905181 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-66e52837-75d6-4681-9b41-dd1536bdac37 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:12:59.905715 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-66e52837-75d6-4681-9b41-dd1536bdac37 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:12:59.993232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-66e52837-75d6-4681-9b41-dd1536bdac37 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101509 May 16 19:12:59.993880 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 377/734] 10.222.0.24 () {58 vars in 1274 bytes} [Mon May 16 19:12:59 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:13:00.063695 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-dc9fe023-7e59-4112-980e-a7f2a1000229 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94079d9bd7b843f09e1345a79b51e447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47a5832eba495e9a74266e13420ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:00.071290 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-dc9fe023-7e59-4112-980e-a7f2a1000229 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 200 len: 1515 microversion: 2.1 time: 0.239906 May 16 19:13:00.072102 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 358/735] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:12:59 2022] GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 1515 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:00.155122 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7a96966e-eade-4107-afcc-bc69a69d61dd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:00.155915 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7a96966e-eade-4107-afcc-bc69a69d61dd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:00.162485 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7a96966e-eade-4107-afcc-bc69a69d61dd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:00.163066 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7a96966e-eade-4107-afcc-bc69a69d61dd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:00.164138 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7a96966e-eade-4107-afcc-bc69a69d61dd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:00.165456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7a96966e-eade-4107-afcc-bc69a69d61dd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:00.179387 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-7a96966e-eade-4107-afcc-bc69a69d61dd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] HTTP exception thrown: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7a96966e-eade-4107-afcc-bc69a69d61dd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Request method failure captured: May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 HTTP/1.1 May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqEf8G2zG4vGLa6fRQSxVwXOFVu4jsLZ-B29p_0lSs6jcAWOYCZkY1DornZdhZVXCJqS0zwV5auuRvXLpuRGlzre_qEDa7s0YeoNCV-K5cylz8uVnntU7yWfEsEGHGxlrx6W7bVdUfRTVT8W0BjJSqyY4x_YtcipuicFgB8svbPs79I May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Openstack-Nova-Api-Version: 2.20 May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: 70432660a05b4b169939f7048c545bfc May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:13:00.181179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:13:00.182822 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/70432660a05b4b169939f7048c545bfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/70432660a05b4b169939f7048c545bfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/70432660a05b4b169939f7048c545bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_70432660a05b4b169939f7048c545bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:13:00.182822 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:13:00.182822 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: 70432660a05b4b169939f7048c545bfc May 16 19:13:00.182822 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:13:00.182822 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-AttachVolumeShelveTestJSON-1982681477-project May 16 19:13:00.182822 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:13:00.182822 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:13:00.182822 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 661228875e4d4c60a558656b46ea650b May 16 19:13:00.182822 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1982681477-project May 16 19:13:00.182822 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:13:00.182822 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. May 16 19:13:00.182822 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': 'd5b53695-b6e7-4e7b-b6d5-539770d20f41'} May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:13:00.183641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. May 16 19:13:00.184863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:13:00.186052 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7a96966e-eade-4107-afcc-bc69a69d61dd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Returning 404 to user: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:13:00.186052 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7a96966e-eade-4107-afcc-bc69a69d61dd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 404 len: 111 microversion: 2.20 time: 0.031815 May 16 19:13:00.186052 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 378/736] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:00 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 19:13:00.193613 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4b0f792f-ca4f-4b2b-b156-97039856ca5f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '.version_select at 0x7f1e0be875e0>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:00.214537 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4b0f792f-ca4f-4b2b-b156-97039856ca5f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2043655114" status: 204 len: 0 microversion: 2.20 time: 0.024923 May 16 19:13:00.215231 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 359/737] 10.222.0.24 () {60 vars in 1261 bytes} [Mon May 16 19:13:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2043655114 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 19:13:00.316658 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-a1935cb5-a74c-4eff-b549-b3f346123b88 req-d6e67bc4-f457-4efb-b564-d57603703326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c82423-6014-4a34-b5fd-2386a32d7a9f", "name": "network-vif-deleted", "tag": "34b2cb1d-a1fe-42c4-89ca-0964ac9881e8"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:00.328706 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-a1935cb5-a74c-4eff-b549-b3f346123b88 req-d6e67bc4-f457-4efb-b564-d57603703326 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:00.329588 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-a1935cb5-a74c-4eff-b549-b3f346123b88 req-d6e67bc4-f457-4efb-b564-d57603703326 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:00.343624 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-a1935cb5-a74c-4eff-b549-b3f346123b88 req-d6e67bc4-f457-4efb-b564-d57603703326 service nova] Creating event network-vif-deleted:34b2cb1d-a1fe-42c4-89ca-0964ac9881e8 for instance 29c82423-6014-4a34-b5fd-2386a32d7a9f on hv-cinder-76606 May 16 19:13:00.349566 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-a1935cb5-a74c-4eff-b549-b3f346123b88 req-d6e67bc4-f457-4efb-b564-d57603703326 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037402 May 16 19:13:00.350661 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 379/738] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:00.640796 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e3ca674d-b6de-43a0-afed-ef34fe5dad92 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:00.641503 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e3ca674d-b6de-43a0-afed-ef34fe5dad92 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:00.648690 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e3ca674d-b6de-43a0-afed-ef34fe5dad92 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:00.649223 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e3ca674d-b6de-43a0-afed-ef34fe5dad92 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:00.650106 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e3ca674d-b6de-43a0-afed-ef34fe5dad92 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:00.650665 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e3ca674d-b6de-43a0-afed-ef34fe5dad92 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:00.836195 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e3ca674d-b6de-43a0-afed-ef34fe5dad92 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:00.852006 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e3ca674d-b6de-43a0-afed-ef34fe5dad92 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.214036 May 16 19:13:00.861934 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 360/739] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:00 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:00.971203 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-b29e197c-a343-4676-ba75-2aa9ac5b55c3 req-96ef8ff8-64e8-465a-b9cf-051bf0cc2320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7436d70f-ee98-42cc-95ff-4aa094d149c8", "tag": "34e977f1-14f8-42d4-a048-80b967122723"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:00.979696 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-b29e197c-a343-4676-ba75-2aa9ac5b55c3 req-96ef8ff8-64e8-465a-b9cf-051bf0cc2320 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:00.980137 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-b29e197c-a343-4676-ba75-2aa9ac5b55c3 req-96ef8ff8-64e8-465a-b9cf-051bf0cc2320 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:01.002250 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-b29e197c-a343-4676-ba75-2aa9ac5b55c3 req-96ef8ff8-64e8-465a-b9cf-051bf0cc2320 service nova] Creating event network-changed:34e977f1-14f8-42d4-a048-80b967122723 for instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 on hv-cinder-76606 May 16 19:13:01.008365 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-b29e197c-a343-4676-ba75-2aa9ac5b55c3 req-96ef8ff8-64e8-465a-b9cf-051bf0cc2320 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041523 May 16 19:13:01.009089 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 380/740] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:01.032697 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5ccdb36e-d579-4a6b-83fa-d60a995b32a6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Action: 'create', calling method: .version_select at 0x7f1e0bee2040>, body: {"keypair": {"name": "tempest-keypair-403318568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt3DlvMM6xS+vIrZgQ0h8zrTBMyl5XqzCIKAe8OjFkXhovFuQdz+lY6h//U9iNO9ujBeiB+0feWCTRcJ/b8+grhPeR2AeqR5+IrvD4mlh9XVTd34tI/pSXbYhiXFZcGFw=="}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:01.048672 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-5ccdb36e-d579-4a6b-83fa-d60a995b32a6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Getting quotas for project 70432660a05b4b169939f7048c545bfc. Resources: {'key_pairs'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:13:01.052688 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-5ccdb36e-d579-4a6b-83fa-d60a995b32a6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Getting quotas for user 661228875e4d4c60a558656b46ea650b and project 70432660a05b4b169939f7048c545bfc. Resources: {'key_pairs'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:13:01.079978 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5ccdb36e-d579-4a6b-83fa-d60a995b32a6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.051197 May 16 19:13:01.080916 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 361/741] 10.222.0.24 () {62 vars in 1199 bytes} [Mon May 16 19:13:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 19:13:01.091500 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-66c20b42-5e62-453b-91bd-04bd3a16fcf9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:01.092203 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-66c20b42-5e62-453b-91bd-04bd3a16fcf9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] [instance: 29c82423-6014-4a34-b5fd-2386a32d7a9f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:01.099014 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-66c20b42-5e62-453b-91bd-04bd3a16fcf9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:01.099496 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-66c20b42-5e62-453b-91bd-04bd3a16fcf9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:01.100472 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-66c20b42-5e62-453b-91bd-04bd3a16fcf9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:01.100892 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-66c20b42-5e62-453b-91bd-04bd3a16fcf9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:01.118457 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-66c20b42-5e62-453b-91bd-04bd3a16fcf9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] HTTP exception thrown: Instance 29c82423-6014-4a34-b5fd-2386a32d7a9f could not be found. May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-66c20b42-5e62-453b-91bd-04bd3a16fcf9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Request method failure captured: May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f HTTP/1.1 May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqGfLdYAU2yWfv1qHdJUomB4kvQrle9E34wQOzoS03SquReRAMH3GRkxuEaVztclYjKFoEK5WowlaUf1KGpirV412P3DCwzxWPRzB0fQncbHaqhUA-YA6v-wE1zbYsSvJbLTd6Ye95rU0A4L933oGfW5jGsMCgItgdj0BU4EocBpqgI May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: 3f47a5832eba495e9a74266e13420ebb May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1034163992 May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:13:01.120264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:13:01.121856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3f47a5832eba495e9a74266e13420ebb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3f47a5832eba495e9a74266e13420ebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3f47a5832eba495e9a74266e13420ebb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3f47a5832eba495e9a74266e13420ebb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:13:01.121856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-VolumesSnapshotTestJSON-1034163992 May 16 19:13:01.121856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: 3f47a5832eba495e9a74266e13420ebb May 16 19:13:01.121856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1034163992 May 16 19:13:01.121856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-VolumesSnapshotTestJSON-1034163992-project May 16 19:13:01.121856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:13:01.121856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:13:01.121856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 94079d9bd7b843f09e1345a79b51e447 May 16 19:13:01.121856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-VolumesSnapshotTestJSON-1034163992-project May 16 19:13:01.121856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:13:01.121856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance 29c82423-6014-4a34-b5fd-2386a32d7a9f could not be found. May 16 19:13:01.121856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': '29c82423-6014-4a34-b5fd-2386a32d7a9f'} May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29c82423-6014-4a34-b5fd-2386a32d7a9f could not be found. May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:13:01.122716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29c82423-6014-4a34-b5fd-2386a32d7a9f could not be found. May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29c82423-6014-4a34-b5fd-2386a32d7a9f could not be found. May 16 19:13:01.124094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:13:01.125264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-66c20b42-5e62-453b-91bd-04bd3a16fcf9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] Returning 404 to user: Instance 29c82423-6014-4a34-b5fd-2386a32d7a9f could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:13:01.125264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-66c20b42-5e62-453b-91bd-04bd3a16fcf9 tempest-VolumesSnapshotTestJSON-1034163992 tempest-VolumesSnapshotTestJSON-1034163992-project] 10.222.0.24 "GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f" status: 404 len: 111 microversion: 2.1 time: 0.034483 May 16 19:13:01.126235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 381/742] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:01 2022] GET /compute/v2.1/servers/29c82423-6014-4a34-b5fd-2386a32d7a9f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:13:01.872964 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c6fa9de8-b99b-4e25-b1d5-0851482800d5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:01.873983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c6fa9de8-b99b-4e25-b1d5-0851482800d5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:01.881908 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c6fa9de8-b99b-4e25-b1d5-0851482800d5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:01.883328 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c6fa9de8-b99b-4e25-b1d5-0851482800d5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:01.884446 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c6fa9de8-b99b-4e25-b1d5-0851482800d5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:01.885202 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c6fa9de8-b99b-4e25-b1d5-0851482800d5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:02.029555 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c6fa9de8-b99b-4e25-b1d5-0851482800d5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:02.038099 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c6fa9de8-b99b-4e25-b1d5-0851482800d5 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.169668 May 16 19:13:02.038692 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 362/743] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:01 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:02.725189 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-3ae1c23f-e988-4393-86b1-0af9635201d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1841548068", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d891ed5e-5c1c-4920-894a-8addbe008c14"}], "security_groups": [{"name": "tempest-securitygroup--1426772481"}], "key_name": "tempest-keypair-403318568", "user_data": "}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:02.825298 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.network.neutron [None req-3ae1c23f-e988-4393-86b1-0af9635201d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] validate_networks() for [('d891ed5e-5c1c-4920-894a-8addbe008c14', None, None, None, None, None)] {{(pid=117274) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:13:03.055567 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-61d7caf8-d9e5-4fc9-840f-ceea2fd7d252 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:03.056182 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-61d7caf8-d9e5-4fc9-840f-ceea2fd7d252 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:03.062914 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-61d7caf8-d9e5-4fc9-840f-ceea2fd7d252 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:03.063364 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-61d7caf8-d9e5-4fc9-840f-ceea2fd7d252 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:03.064139 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-61d7caf8-d9e5-4fc9-840f-ceea2fd7d252 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:03.064569 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-61d7caf8-d9e5-4fc9-840f-ceea2fd7d252 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:03.194382 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-61d7caf8-d9e5-4fc9-840f-ceea2fd7d252 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:03.195156 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-3ae1c23f-e988-4393-86b1-0af9635201d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Flavor limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:13:03.195709 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-3ae1c23f-e988-4393-86b1-0af9635201d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Image limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:13:03.196174 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-3ae1c23f-e988-4393-86b1-0af9635201d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Flavor pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:13:03.196594 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-3ae1c23f-e988-4393-86b1-0af9635201d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Image pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:13:03.196974 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-3ae1c23f-e988-4393-86b1-0af9635201d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:13:03.202551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-61d7caf8-d9e5-4fc9-840f-ceea2fd7d252 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.150921 May 16 19:13:03.203152 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 363/744] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:03 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:03.205994 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3ae1c23f-e988-4393-86b1-0af9635201d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:03.206434 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3ae1c23f-e988-4393-86b1-0af9635201d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:03.207228 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3ae1c23f-e988-4393-86b1-0af9635201d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:03.207653 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3ae1c23f-e988-4393-86b1-0af9635201d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:03.223501 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-3ae1c23f-e988-4393-86b1-0af9635201d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Getting quotas for project 70432660a05b4b169939f7048c545bfc. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:13:03.227472 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-3ae1c23f-e988-4393-86b1-0af9635201d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Getting quotas for user 661228875e4d4c60a558656b46ea650b and project 70432660a05b4b169939f7048c545bfc. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:13:03.238474 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-3ae1c23f-e988-4393-86b1-0af9635201d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Going to run 1 instances... {{(pid=117274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:13:03.240793 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-3ae1c23f-e988-4393-86b1-0af9635201d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:13:03.289813 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-3ae1c23f-e988-4393-86b1-0af9635201d2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.569485 May 16 19:13:03.290447 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 382/745] 10.222.0.24 () {62 vars in 1187 bytes} [Mon May 16 19:13:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 16 19:13:03.300756 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-557f4899-81da-40da-acf6-82e780384578 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:03.301363 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-557f4899-81da-40da-acf6-82e780384578 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:03.352375 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-557f4899-81da-40da-acf6-82e780384578 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:03.359351 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-557f4899-81da-40da-acf6-82e780384578 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:03.360833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-557f4899-81da-40da-acf6-82e780384578 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:03.361971 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-557f4899-81da-40da-acf6-82e780384578 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1281 microversion: 2.20 time: 0.065171 May 16 19:13:03.362546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 364/746] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:03 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1281 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:13:04.224395 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-809da09c-e330-4e8e-aaa4-c436b9d787df tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:04.225401 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-809da09c-e330-4e8e-aaa4-c436b9d787df tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:04.236164 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-809da09c-e330-4e8e-aaa4-c436b9d787df tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:04.236915 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-809da09c-e330-4e8e-aaa4-c436b9d787df tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:04.238270 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-809da09c-e330-4e8e-aaa4-c436b9d787df tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:04.238989 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-809da09c-e330-4e8e-aaa4-c436b9d787df tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:04.380411 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-80af969d-efb5-4517-8b4a-647abfc61e69 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:04.381047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-80af969d-efb5-4517-8b4a-647abfc61e69 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:04.388290 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-80af969d-efb5-4517-8b4a-647abfc61e69 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:04.388740 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-80af969d-efb5-4517-8b4a-647abfc61e69 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:04.389523 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-80af969d-efb5-4517-8b4a-647abfc61e69 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:04.389990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-80af969d-efb5-4517-8b4a-647abfc61e69 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:04.496988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-809da09c-e330-4e8e-aaa4-c436b9d787df tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:04.505755 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-809da09c-e330-4e8e-aaa4-c436b9d787df tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.288619 May 16 19:13:04.506322 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 383/747] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:04 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:04.514588 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-80af969d-efb5-4517-8b4a-647abfc61e69 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:04.523420 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-80af969d-efb5-4517-8b4a-647abfc61e69 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:04.524923 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-80af969d-efb5-4517-8b4a-647abfc61e69 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:04.526070 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-80af969d-efb5-4517-8b4a-647abfc61e69 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1285 microversion: 2.20 time: 0.149673 May 16 19:13:04.526648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 365/748] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:04 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:13:05.526475 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2ecc7e14-7374-4926-b938-1b2575d0ab4d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:05.527106 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2ecc7e14-7374-4926-b938-1b2575d0ab4d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:05.535995 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2ecc7e14-7374-4926-b938-1b2575d0ab4d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:05.536488 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2ecc7e14-7374-4926-b938-1b2575d0ab4d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:05.537345 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2ecc7e14-7374-4926-b938-1b2575d0ab4d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:05.537854 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2ecc7e14-7374-4926-b938-1b2575d0ab4d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:05.544888 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f5754139-3bd5-45d0-88eb-2617a7d9785c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:05.545628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f5754139-3bd5-45d0-88eb-2617a7d9785c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:05.553187 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f5754139-3bd5-45d0-88eb-2617a7d9785c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:05.553814 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f5754139-3bd5-45d0-88eb-2617a7d9785c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:05.554894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f5754139-3bd5-45d0-88eb-2617a7d9785c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:05.555684 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f5754139-3bd5-45d0-88eb-2617a7d9785c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:05.620826 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f5754139-3bd5-45d0-88eb-2617a7d9785c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:05.629984 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f5754139-3bd5-45d0-88eb-2617a7d9785c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:05.631620 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f5754139-3bd5-45d0-88eb-2617a7d9785c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:05.633411 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f5754139-3bd5-45d0-88eb-2617a7d9785c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1285 microversion: 2.20 time: 0.092586 May 16 19:13:05.634746 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 366/749] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:05 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:13:05.679697 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2ecc7e14-7374-4926-b938-1b2575d0ab4d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:05.687695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2ecc7e14-7374-4926-b938-1b2575d0ab4d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.166928 May 16 19:13:05.688268 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 384/750] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:05 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:06.653025 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c56bec96-1431-4fc1-a751-266727abfdc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:06.653648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c56bec96-1431-4fc1-a751-266727abfdc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:06.660524 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c56bec96-1431-4fc1-a751-266727abfdc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:06.660969 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c56bec96-1431-4fc1-a751-266727abfdc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:06.661789 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c56bec96-1431-4fc1-a751-266727abfdc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:06.662201 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c56bec96-1431-4fc1-a751-266727abfdc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:06.704235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e1ddc145-d1f1-42e0-9367-5ae9b5024a28 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:06.704853 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e1ddc145-d1f1-42e0-9367-5ae9b5024a28 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:06.711755 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e1ddc145-d1f1-42e0-9367-5ae9b5024a28 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:06.712206 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e1ddc145-d1f1-42e0-9367-5ae9b5024a28 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:06.712977 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e1ddc145-d1f1-42e0-9367-5ae9b5024a28 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:06.713409 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e1ddc145-d1f1-42e0-9367-5ae9b5024a28 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:06.729733 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c56bec96-1431-4fc1-a751-266727abfdc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:06.738090 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c56bec96-1431-4fc1-a751-266727abfdc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:06.739590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c56bec96-1431-4fc1-a751-266727abfdc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:06.740697 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c56bec96-1431-4fc1-a751-266727abfdc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1333 microversion: 2.20 time: 0.091692 May 16 19:13:06.741486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 367/751] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:06 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:13:06.843433 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e1ddc145-d1f1-42e0-9367-5ae9b5024a28 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:06.851707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e1ddc145-d1f1-42e0-9367-5ae9b5024a28 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.151198 May 16 19:13:06.852309 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 385/752] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:06 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:07.760638 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b296fe71-6297-4189-bf15-8d9d3c09476b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:07.761367 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b296fe71-6297-4189-bf15-8d9d3c09476b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:07.768496 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b296fe71-6297-4189-bf15-8d9d3c09476b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:07.769008 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b296fe71-6297-4189-bf15-8d9d3c09476b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:07.769843 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b296fe71-6297-4189-bf15-8d9d3c09476b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:07.770279 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b296fe71-6297-4189-bf15-8d9d3c09476b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:07.868883 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-95dc1a12-4552-48d9-8c23-d2607cb6db70 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:07.869470 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-95dc1a12-4552-48d9-8c23-d2607cb6db70 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:07.876693 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-95dc1a12-4552-48d9-8c23-d2607cb6db70 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:07.877221 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-95dc1a12-4552-48d9-8c23-d2607cb6db70 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:07.878116 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-95dc1a12-4552-48d9-8c23-d2607cb6db70 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:07.878654 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-95dc1a12-4552-48d9-8c23-d2607cb6db70 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:08.016899 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-95dc1a12-4552-48d9-8c23-d2607cb6db70 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:08.026604 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-95dc1a12-4552-48d9-8c23-d2607cb6db70 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.161897 May 16 19:13:08.027159 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 386/753] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:07 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:08.064997 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b296fe71-6297-4189-bf15-8d9d3c09476b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:08.072888 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b296fe71-6297-4189-bf15-8d9d3c09476b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:08.074401 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b296fe71-6297-4189-bf15-8d9d3c09476b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:08.075522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b296fe71-6297-4189-bf15-8d9d3c09476b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1339 microversion: 2.20 time: 0.319601 May 16 19:13:08.076093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 368/754] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:07 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1339 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:13:09.044041 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b1c2036d-83e4-41da-9901-e483315e13bf tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:09.044912 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b1c2036d-83e4-41da-9901-e483315e13bf tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:09.051702 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b1c2036d-83e4-41da-9901-e483315e13bf tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:09.052146 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b1c2036d-83e4-41da-9901-e483315e13bf tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:09.052918 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b1c2036d-83e4-41da-9901-e483315e13bf tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:09.053357 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b1c2036d-83e4-41da-9901-e483315e13bf tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:09.097293 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-b75df477-bd11-483f-9d2a-7bfd53847346 req-e4802c40-7950-4fca-8c8d-8e6fb57cc073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b664a08c-f97e-4c52-b849-9eddb2e65be5", "tag": "34940ecb-c2a4-45ca-ad50-7ea9f112b22a"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:09.107544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-b75df477-bd11-483f-9d2a-7bfd53847346 req-e4802c40-7950-4fca-8c8d-8e6fb57cc073 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:09.108199 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-b75df477-bd11-483f-9d2a-7bfd53847346 req-e4802c40-7950-4fca-8c8d-8e6fb57cc073 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:09.120201 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-b75df477-bd11-483f-9d2a-7bfd53847346 req-e4802c40-7950-4fca-8c8d-8e6fb57cc073 service nova] Creating event network-changed:34940ecb-c2a4-45ca-ad50-7ea9f112b22a for instance b664a08c-f97e-4c52-b849-9eddb2e65be5 on hv-cinder-76606 May 16 19:13:09.129367 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-b75df477-bd11-483f-9d2a-7bfd53847346 req-e4802c40-7950-4fca-8c8d-8e6fb57cc073 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035359 May 16 19:13:09.132009 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 369/755] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:09.139144 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-fbd70025-2940-46dd-b697-09cb60bfb83a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:09.139887 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-fbd70025-2940-46dd-b697-09cb60bfb83a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:09.148338 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fbd70025-2940-46dd-b697-09cb60bfb83a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:09.148821 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fbd70025-2940-46dd-b697-09cb60bfb83a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:09.149645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fbd70025-2940-46dd-b697-09cb60bfb83a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:09.150079 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-fbd70025-2940-46dd-b697-09cb60bfb83a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:09.223333 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b1c2036d-83e4-41da-9901-e483315e13bf tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:09.232399 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b1c2036d-83e4-41da-9901-e483315e13bf tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.192414 May 16 19:13:09.241424 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 387/756] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:09 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:09.396869 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-fbd70025-2940-46dd-b697-09cb60bfb83a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:09.404869 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-fbd70025-2940-46dd-b697-09cb60bfb83a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:09.406407 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-fbd70025-2940-46dd-b697-09cb60bfb83a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:09.407523 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-fbd70025-2940-46dd-b697-09cb60bfb83a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1407 microversion: 2.20 time: 0.274151 May 16 19:13:09.408095 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 370/757] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:09 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:13:10.125281 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-fd41690a-dea5-42b2-a52e-93ee6120fb55 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:10.126352 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-fd41690a-dea5-42b2-a52e-93ee6120fb55 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:10.133045 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fd41690a-dea5-42b2-a52e-93ee6120fb55 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:10.133495 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fd41690a-dea5-42b2-a52e-93ee6120fb55 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:10.134302 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fd41690a-dea5-42b2-a52e-93ee6120fb55 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:10.134745 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fd41690a-dea5-42b2-a52e-93ee6120fb55 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:10.164126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-fd41690a-dea5-42b2-a52e-93ee6120fb55 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042923 May 16 19:13:10.164686 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 388/758] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:13:10 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 19:13:10.249935 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f22b6e3e-2c94-4bc2-b27f-f530f18552e3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:10.250541 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f22b6e3e-2c94-4bc2-b27f-f530f18552e3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:10.256664 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f22b6e3e-2c94-4bc2-b27f-f530f18552e3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:10.257103 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f22b6e3e-2c94-4bc2-b27f-f530f18552e3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:10.257899 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f22b6e3e-2c94-4bc2-b27f-f530f18552e3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:10.258326 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f22b6e3e-2c94-4bc2-b27f-f530f18552e3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:10.327213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-be495cfd-1417-475d-a572-63022bc596a0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:10.327752 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-be495cfd-1417-475d-a572-63022bc596a0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:10.333750 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-be495cfd-1417-475d-a572-63022bc596a0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:10.334193 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-be495cfd-1417-475d-a572-63022bc596a0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:10.335031 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-be495cfd-1417-475d-a572-63022bc596a0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:10.335611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-be495cfd-1417-475d-a572-63022bc596a0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:10.360932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-be495cfd-1417-475d-a572-63022bc596a0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Going to try to terminate instance {{(pid=117275) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:13:10.392532 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f22b6e3e-2c94-4bc2-b27f-f530f18552e3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:10.401806 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f22b6e3e-2c94-4bc2-b27f-f530f18552e3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.155670 May 16 19:13:10.402385 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 389/759] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:10 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:10.424855 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-31a66969-f756-4f41-9a21-920e85494147 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:10.425586 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-31a66969-f756-4f41-9a21-920e85494147 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:10.431525 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-31a66969-f756-4f41-9a21-920e85494147 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:10.432043 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-31a66969-f756-4f41-9a21-920e85494147 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:10.432878 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-31a66969-f756-4f41-9a21-920e85494147 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:10.433674 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-31a66969-f756-4f41-9a21-920e85494147 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:10.439134 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-be495cfd-1417-475d-a572-63022bc596a0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 204 len: 0 microversion: 2.1 time: 0.222567 May 16 19:13:10.442901 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 371/760] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:13:10 2022] DELETE /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 19:13:10.449062 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c6aeec19-1f7a-419b-aba9-bed027794e34 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:10.449811 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c6aeec19-1f7a-419b-aba9-bed027794e34 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:10.455762 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c6aeec19-1f7a-419b-aba9-bed027794e34 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:10.456283 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c6aeec19-1f7a-419b-aba9-bed027794e34 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:10.457063 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c6aeec19-1f7a-419b-aba9-bed027794e34 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:10.457500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c6aeec19-1f7a-419b-aba9-bed027794e34 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:10.565987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-31a66969-f756-4f41-9a21-920e85494147 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:10.573948 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-31a66969-f756-4f41-9a21-920e85494147 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:10.575425 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-31a66969-f756-4f41-9a21-920e85494147 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:10.576532 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-31a66969-f756-4f41-9a21-920e85494147 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1407 microversion: 2.20 time: 0.155487 May 16 19:13:10.577114 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 390/761] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:10 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:13:10.589398 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c6aeec19-1f7a-419b-aba9-bed027794e34 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:10.597125 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c6aeec19-1f7a-419b-aba9-bed027794e34 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1672 microversion: 2.1 time: 0.153084 May 16 19:13:10.597725 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 372/762] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:10 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:11.423613 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-97ea5156-233a-489f-9e31-760b6a9c283b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:11.424444 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-97ea5156-233a-489f-9e31-760b6a9c283b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:11.435436 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-97ea5156-233a-489f-9e31-760b6a9c283b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:11.436220 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-97ea5156-233a-489f-9e31-760b6a9c283b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:11.437466 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-97ea5156-233a-489f-9e31-760b6a9c283b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:11.438250 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-97ea5156-233a-489f-9e31-760b6a9c283b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:11.577500 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-97ea5156-233a-489f-9e31-760b6a9c283b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:11.585644 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-97ea5156-233a-489f-9e31-760b6a9c283b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.168633 May 16 19:13:11.586214 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 391/763] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:11 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:11.594599 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-48da67ee-4d71-4b79-b8bc-e8a1c5886a38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:11.595198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-48da67ee-4d71-4b79-b8bc-e8a1c5886a38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:11.602165 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-48da67ee-4d71-4b79-b8bc-e8a1c5886a38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:11.602619 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-48da67ee-4d71-4b79-b8bc-e8a1c5886a38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:11.603375 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-48da67ee-4d71-4b79-b8bc-e8a1c5886a38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:11.603802 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-48da67ee-4d71-4b79-b8bc-e8a1c5886a38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:11.613718 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-289891c2-e935-456f-91b9-bae033a6d11a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:11.614320 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-289891c2-e935-456f-91b9-bae033a6d11a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:11.620890 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-289891c2-e935-456f-91b9-bae033a6d11a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:11.621346 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-289891c2-e935-456f-91b9-bae033a6d11a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:11.622155 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-289891c2-e935-456f-91b9-bae033a6d11a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:11.622585 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-289891c2-e935-456f-91b9-bae033a6d11a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:11.743947 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-48da67ee-4d71-4b79-b8bc-e8a1c5886a38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:11.752183 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-48da67ee-4d71-4b79-b8bc-e8a1c5886a38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:11.753704 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-48da67ee-4d71-4b79-b8bc-e8a1c5886a38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:11.754828 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-48da67ee-4d71-4b79-b8bc-e8a1c5886a38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1407 microversion: 2.20 time: 0.164202 May 16 19:13:11.755391 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 373/764] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:11 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:13:11.773946 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-289891c2-e935-456f-91b9-bae033a6d11a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:11.781386 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-289891c2-e935-456f-91b9-bae033a6d11a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1672 microversion: 2.1 time: 0.171590 May 16 19:13:11.781993 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 392/765] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:11 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:12.070153 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c37cd54a-6417-44f2-863a-ce6e0c9a9ae2 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-153102917"}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:12.070579 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c37cd54a-6417-44f2-863a-ce6e0c9a9ae2 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:12.077306 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c37cd54a-6417-44f2-863a-ce6e0c9a9ae2 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:12.077786 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c37cd54a-6417-44f2-863a-ce6e0c9a9ae2 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:12.078551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c37cd54a-6417-44f2-863a-ce6e0c9a9ae2 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:12.078993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c37cd54a-6417-44f2-863a-ce6e0c9a9ae2 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:12.205898 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.network.security_group_api [None req-c37cd54a-6417-44f2-863a-ce6e0c9a9ae2 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Removing security group 7a7af06b-3403-412f-9e75-8297761b6afd from port 12358361-c4bc-4509-98f8-117b7fd4543e May 16 19:13:12.587265 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c37cd54a-6417-44f2-863a-ce6e0c9a9ae2 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "POST /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/action" status: 202 len: 0 microversion: 2.1 time: 0.521189 May 16 19:13:12.587846 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 374/766] 10.222.0.24 () {60 vars in 1277 bytes} [Mon May 16 19:13:12 2022] POST /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:13:12.599564 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-701f15bf-c96e-413f-b481-89091e79632f req-755d8680-4ac3-492b-bd86-42509006e1ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e0298bd-7166-4b67-acf1-794621e95cdf", "tag": "12358361-c4bc-4509-98f8-117b7fd4543e"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:12.608679 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-980de9d2-8290-41b0-9b69-a176e65dbf62 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:12.609227 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-701f15bf-c96e-413f-b481-89091e79632f req-755d8680-4ac3-492b-bd86-42509006e1ee service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:12.609227 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-701f15bf-c96e-413f-b481-89091e79632f req-755d8680-4ac3-492b-bd86-42509006e1ee service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:12.609431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-980de9d2-8290-41b0-9b69-a176e65dbf62 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:12.625977 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-701f15bf-c96e-413f-b481-89091e79632f req-755d8680-4ac3-492b-bd86-42509006e1ee service nova] Creating event network-changed:12358361-c4bc-4509-98f8-117b7fd4543e for instance 1e0298bd-7166-4b67-acf1-794621e95cdf on hv-cinder-76606 May 16 19:13:12.626319 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-980de9d2-8290-41b0-9b69-a176e65dbf62 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:12.627079 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-980de9d2-8290-41b0-9b69-a176e65dbf62 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:12.628627 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-980de9d2-8290-41b0-9b69-a176e65dbf62 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:12.629062 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-980de9d2-8290-41b0-9b69-a176e65dbf62 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:12.634583 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-701f15bf-c96e-413f-b481-89091e79632f req-755d8680-4ac3-492b-bd86-42509006e1ee service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039806 May 16 19:13:12.640289 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 393/767] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:12.774779 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-04c57f89-726f-43cd-b4ac-f0d7069c696f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:12.775446 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-04c57f89-726f-43cd-b4ac-f0d7069c696f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:12.777560 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-980de9d2-8290-41b0-9b69-a176e65dbf62 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:12.785766 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-980de9d2-8290-41b0-9b69-a176e65dbf62 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.187003 May 16 19:13:12.786753 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-04c57f89-726f-43cd-b4ac-f0d7069c696f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:12.796194 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-04c57f89-726f-43cd-b4ac-f0d7069c696f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:12.796194 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-04c57f89-726f-43cd-b4ac-f0d7069c696f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:12.796194 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-04c57f89-726f-43cd-b4ac-f0d7069c696f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:12.796905 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 375/768] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:12 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:12.804389 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-63e80f81-a5e8-4f18-b72c-fc75ae9b16e2 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:12.805624 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-63e80f81-a5e8-4f18-b72c-fc75ae9b16e2 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:12.814071 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-63e80f81-a5e8-4f18-b72c-fc75ae9b16e2 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:12.814716 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-63e80f81-a5e8-4f18-b72c-fc75ae9b16e2 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:12.815660 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-63e80f81-a5e8-4f18-b72c-fc75ae9b16e2 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:12.816248 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-63e80f81-a5e8-4f18-b72c-fc75ae9b16e2 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:12.982142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-04c57f89-726f-43cd-b4ac-f0d7069c696f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:12.990427 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-04c57f89-726f-43cd-b4ac-f0d7069c696f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:12.991971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-04c57f89-726f-43cd-b4ac-f0d7069c696f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:12.993340 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-04c57f89-726f-43cd-b4ac-f0d7069c696f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1407 microversion: 2.20 time: 0.224464 May 16 19:13:12.993969 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 394/769] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:12 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:13:13.019300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-63e80f81-a5e8-4f18-b72c-fc75ae9b16e2 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:13.027270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-63e80f81-a5e8-4f18-b72c-fc75ae9b16e2 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1672 microversion: 2.1 time: 0.228527 May 16 19:13:13.027844 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 376/770] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:12 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1672 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:13.806847 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-eeaf6b07-a6ea-4f78-b48b-5ea8c5ceba15 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:13.810185 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-eeaf6b07-a6ea-4f78-b48b-5ea8c5ceba15 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:13.821830 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-eeaf6b07-a6ea-4f78-b48b-5ea8c5ceba15 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:13.822357 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-eeaf6b07-a6ea-4f78-b48b-5ea8c5ceba15 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:13.823439 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-eeaf6b07-a6ea-4f78-b48b-5ea8c5ceba15 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:13.823951 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-eeaf6b07-a6ea-4f78-b48b-5ea8c5ceba15 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:13.834578 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3d85ef67-9576-4595-9981-4f35876bf597 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:13.835108 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-3d85ef67-9576-4595-9981-4f35876bf597 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:13.841409 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3d85ef67-9576-4595-9981-4f35876bf597 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:13.845799 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3d85ef67-9576-4595-9981-4f35876bf597 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:13.846810 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3d85ef67-9576-4595-9981-4f35876bf597 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:13.847411 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3d85ef67-9576-4595-9981-4f35876bf597 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:13.927391 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.objects.instance [None req-3d85ef67-9576-4595-9981-4f35876bf597 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lazy-loading 'services' on Instance uuid 1e0298bd-7166-4b67-acf1-794621e95cdf {{(pid=117275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:13:13.972013 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-eeaf6b07-a6ea-4f78-b48b-5ea8c5ceba15 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:13.983000 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-eeaf6b07-a6ea-4f78-b48b-5ea8c5ceba15 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.183244 May 16 19:13:13.992948 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 395/771] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:13 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:14.004221 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-3d85ef67-9576-4595-9981-4f35876bf597 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "DELETE /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/os-volume_attachments/3c5f7867-5cca-4b95-979a-60df47a25fbb" status: 202 len: 0 microversion: 2.1 time: 0.173293 May 16 19:13:14.007891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 377/772] 10.222.0.24 () {58 vars in 1415 bytes} [Mon May 16 19:13:13 2022] DELETE /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/os-volume_attachments/3c5f7867-5cca-4b95-979a-60df47a25fbb => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:13:14.013401 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-077bcbb2-e5d2-4f15-9bdd-e66c5214be3b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:14.013743 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7db9a5f7-0b64-4153-bf3a-851416ed3400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:14.014386 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7db9a5f7-0b64-4153-bf3a-851416ed3400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:14.015271 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-077bcbb2-e5d2-4f15-9bdd-e66c5214be3b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:14.022888 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-077bcbb2-e5d2-4f15-9bdd-e66c5214be3b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:14.024307 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-077bcbb2-e5d2-4f15-9bdd-e66c5214be3b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:14.025082 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-077bcbb2-e5d2-4f15-9bdd-e66c5214be3b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:14.025513 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-077bcbb2-e5d2-4f15-9bdd-e66c5214be3b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:14.026493 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7db9a5f7-0b64-4153-bf3a-851416ed3400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:14.027281 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7db9a5f7-0b64-4153-bf3a-851416ed3400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:14.028254 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7db9a5f7-0b64-4153-bf3a-851416ed3400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:14.028846 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7db9a5f7-0b64-4153-bf3a-851416ed3400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:14.057368 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-077bcbb2-e5d2-4f15-9bdd-e66c5214be3b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047949 May 16 19:13:14.057973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 378/773] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:13:14 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:14.066048 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0c7c475d-ed63-4d1c-a590-60e9a226ba25 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:14.066653 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0c7c475d-ed63-4d1c-a590-60e9a226ba25 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:14.072677 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0c7c475d-ed63-4d1c-a590-60e9a226ba25 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:14.073312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0c7c475d-ed63-4d1c-a590-60e9a226ba25 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:14.074351 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0c7c475d-ed63-4d1c-a590-60e9a226ba25 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:14.075124 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0c7c475d-ed63-4d1c-a590-60e9a226ba25 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:14.181671 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7db9a5f7-0b64-4153-bf3a-851416ed3400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:14.190259 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7db9a5f7-0b64-4153-bf3a-851416ed3400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:14.192136 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7db9a5f7-0b64-4153-bf3a-851416ed3400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:14.193694 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7db9a5f7-0b64-4153-bf3a-851416ed3400 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1407 microversion: 2.20 time: 0.186369 May 16 19:13:14.204748 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 396/774] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:14 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:13:14.249046 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0c7c475d-ed63-4d1c-a590-60e9a226ba25 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:14.258002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0c7c475d-ed63-4d1c-a590-60e9a226ba25 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1672 microversion: 2.1 time: 0.195575 May 16 19:13:14.258782 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 379/775] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:14 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1672 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:14.653791 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-a4ce149a-256f-4f99-b3ce-e3dadf8ee4d7 req-68aeab9b-f1f8-47ba-a211-451ca1ac1120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e0298bd-7166-4b67-acf1-794621e95cdf", "tag": "12358361-c4bc-4509-98f8-117b7fd4543e"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:14.662735 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-a4ce149a-256f-4f99-b3ce-e3dadf8ee4d7 req-68aeab9b-f1f8-47ba-a211-451ca1ac1120 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:14.663185 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-a4ce149a-256f-4f99-b3ce-e3dadf8ee4d7 req-68aeab9b-f1f8-47ba-a211-451ca1ac1120 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:14.675020 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-a4ce149a-256f-4f99-b3ce-e3dadf8ee4d7 req-68aeab9b-f1f8-47ba-a211-451ca1ac1120 service nova] Creating event network-changed:12358361-c4bc-4509-98f8-117b7fd4543e for instance 1e0298bd-7166-4b67-acf1-794621e95cdf on hv-cinder-76606 May 16 19:13:14.680380 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-a4ce149a-256f-4f99-b3ce-e3dadf8ee4d7 req-68aeab9b-f1f8-47ba-a211-451ca1ac1120 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030355 May 16 19:13:14.681041 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 397/776] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:15.000078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-6a1de751-b42f-4c1f-b1b1-35214254a8ea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:15.000667 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-6a1de751-b42f-4c1f-b1b1-35214254a8ea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:15.007585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6a1de751-b42f-4c1f-b1b1-35214254a8ea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:15.008030 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6a1de751-b42f-4c1f-b1b1-35214254a8ea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:15.008800 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6a1de751-b42f-4c1f-b1b1-35214254a8ea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:15.009233 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6a1de751-b42f-4c1f-b1b1-35214254a8ea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:15.076250 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-179ff955-4434-45f1-94d9-ca9ac92ca5ad tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:15.077434 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-179ff955-4434-45f1-94d9-ca9ac92ca5ad tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:15.083879 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-179ff955-4434-45f1-94d9-ca9ac92ca5ad tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:15.084604 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-179ff955-4434-45f1-94d9-ca9ac92ca5ad tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:15.085521 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-179ff955-4434-45f1-94d9-ca9ac92ca5ad tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:15.086025 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-179ff955-4434-45f1-94d9-ca9ac92ca5ad tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:15.133993 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-179ff955-4434-45f1-94d9-ca9ac92ca5ad tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067860 May 16 19:13:15.134848 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 398/777] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:13:15 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:13:15.211451 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-876ec3cb-7b1f-4963-b0f5-18ee576d2822 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:15.212065 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-876ec3cb-7b1f-4963-b0f5-18ee576d2822 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:15.218284 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-876ec3cb-7b1f-4963-b0f5-18ee576d2822 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:15.218735 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-876ec3cb-7b1f-4963-b0f5-18ee576d2822 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:15.219513 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-876ec3cb-7b1f-4963-b0f5-18ee576d2822 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:15.219944 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-876ec3cb-7b1f-4963-b0f5-18ee576d2822 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:15.258904 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6a1de751-b42f-4c1f-b1b1-35214254a8ea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:15.266927 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-6a1de751-b42f-4c1f-b1b1-35214254a8ea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.270708 May 16 19:13:15.267461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 380/778] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:14 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:15.276233 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-476e8a49-5108-4e68-8e8f-ea2595057294 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:15.277493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-476e8a49-5108-4e68-8e8f-ea2595057294 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:15.283718 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-476e8a49-5108-4e68-8e8f-ea2595057294 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:15.284178 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-476e8a49-5108-4e68-8e8f-ea2595057294 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:15.284937 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-476e8a49-5108-4e68-8e8f-ea2595057294 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:15.285362 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-476e8a49-5108-4e68-8e8f-ea2595057294 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:15.369933 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-876ec3cb-7b1f-4963-b0f5-18ee576d2822 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:15.379856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-876ec3cb-7b1f-4963-b0f5-18ee576d2822 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:15.381433 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-876ec3cb-7b1f-4963-b0f5-18ee576d2822 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:15.383603 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-876ec3cb-7b1f-4963-b0f5-18ee576d2822 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1407 microversion: 2.20 time: 0.175841 May 16 19:13:15.384338 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 399/779] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:15 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:13:15.418086 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-476e8a49-5108-4e68-8e8f-ea2595057294 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:15.425520 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-476e8a49-5108-4e68-8e8f-ea2595057294 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1672 microversion: 2.1 time: 0.153258 May 16 19:13:15.426104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 381/780] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:15 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:16.146985 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5ba7e8b0-f7d3-412e-ba2c-b0828638b9f6 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:16.147903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5ba7e8b0-f7d3-412e-ba2c-b0828638b9f6 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:16.154749 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5ba7e8b0-f7d3-412e-ba2c-b0828638b9f6 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:16.155189 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5ba7e8b0-f7d3-412e-ba2c-b0828638b9f6 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:16.155947 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5ba7e8b0-f7d3-412e-ba2c-b0828638b9f6 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:16.156372 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5ba7e8b0-f7d3-412e-ba2c-b0828638b9f6 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:16.185839 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-5ba7e8b0-f7d3-412e-ba2c-b0828638b9f6 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043283 May 16 19:13:16.186390 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 400/781] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:13:16 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:16.289637 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-73a4876a-705d-4407-a0ef-52dff26d8c8d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:16.290707 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-73a4876a-705d-4407-a0ef-52dff26d8c8d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:16.302004 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-73a4876a-705d-4407-a0ef-52dff26d8c8d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:16.302752 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-73a4876a-705d-4407-a0ef-52dff26d8c8d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:16.304166 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-73a4876a-705d-4407-a0ef-52dff26d8c8d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:16.304608 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-73a4876a-705d-4407-a0ef-52dff26d8c8d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:16.447715 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-73a4876a-705d-4407-a0ef-52dff26d8c8d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:16.456111 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-73a4876a-705d-4407-a0ef-52dff26d8c8d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.173426 May 16 19:13:16.456698 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 382/782] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:16 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:13:16.458564 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-40356d77-b426-4793-b99e-a31ef7280952 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:16.459184 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-40356d77-b426-4793-b99e-a31ef7280952 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:16.461078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e9c3ccd9-c466-41be-b833-89e9774e78d5 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:16.461711 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e9c3ccd9-c466-41be-b833-89e9774e78d5 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:16.465382 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-40356d77-b426-4793-b99e-a31ef7280952 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:16.465858 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-40356d77-b426-4793-b99e-a31ef7280952 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:16.466637 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-40356d77-b426-4793-b99e-a31ef7280952 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:16.467056 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-40356d77-b426-4793-b99e-a31ef7280952 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:16.467538 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e9c3ccd9-c466-41be-b833-89e9774e78d5 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:16.467991 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e9c3ccd9-c466-41be-b833-89e9774e78d5 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:16.468769 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e9c3ccd9-c466-41be-b833-89e9774e78d5 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:16.469199 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e9c3ccd9-c466-41be-b833-89e9774e78d5 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:16.596887 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-40356d77-b426-4793-b99e-a31ef7280952 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:16.603924 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e9c3ccd9-c466-41be-b833-89e9774e78d5 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:16.609115 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-40356d77-b426-4793-b99e-a31ef7280952 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:16.611379 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-40356d77-b426-4793-b99e-a31ef7280952 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:16.611725 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e9c3ccd9-c466-41be-b833-89e9774e78d5 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1672 microversion: 2.1 time: 0.154097 May 16 19:13:16.612297 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 383/783] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:16 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:16.613353 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-40356d77-b426-4793-b99e-a31ef7280952 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1407 microversion: 2.20 time: 0.215313 May 16 19:13:16.614127 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 401/784] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:16 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:13:17.126401 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-dfb5e189-ada4-4e51-9fdd-63ac1557cf8a req-b7b271f4-ab47-4d0a-83d8-0bba5a1a3e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b664a08c-f97e-4c52-b849-9eddb2e65be5", "name": "network-vif-plugged", "status": "completed", "tag": "34940ecb-c2a4-45ca-ad50-7ea9f112b22a"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:17.134731 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-dfb5e189-ada4-4e51-9fdd-63ac1557cf8a req-b7b271f4-ab47-4d0a-83d8-0bba5a1a3e2f service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:17.135202 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-dfb5e189-ada4-4e51-9fdd-63ac1557cf8a req-b7b271f4-ab47-4d0a-83d8-0bba5a1a3e2f service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:17.148313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-dfb5e189-ada4-4e51-9fdd-63ac1557cf8a req-b7b271f4-ab47-4d0a-83d8-0bba5a1a3e2f service nova] Creating event network-vif-plugged:34940ecb-c2a4-45ca-ad50-7ea9f112b22a for instance b664a08c-f97e-4c52-b849-9eddb2e65be5 on hv-cinder-76606 May 16 19:13:17.153372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-dfb5e189-ada4-4e51-9fdd-63ac1557cf8a req-b7b271f4-ab47-4d0a-83d8-0bba5a1a3e2f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030969 May 16 19:13:17.154011 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 384/785] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:13:17.197918 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-40e1d4e0-61f2-49a7-a705-3b5ebb610f21 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:17.199324 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-40e1d4e0-61f2-49a7-a705-3b5ebb610f21 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:17.218568 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-40e1d4e0-61f2-49a7-a705-3b5ebb610f21 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:17.219349 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-40e1d4e0-61f2-49a7-a705-3b5ebb610f21 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:17.226212 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-40e1d4e0-61f2-49a7-a705-3b5ebb610f21 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:17.226772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-40e1d4e0-61f2-49a7-a705-3b5ebb610f21 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:17.294061 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-40e1d4e0-61f2-49a7-a705-3b5ebb610f21 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100507 May 16 19:13:17.299388 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 402/786] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:13:17 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 19:13:17.306702 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-43126009-0044-4821-a89d-9ebd1853ab95 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:17.307893 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-43126009-0044-4821-a89d-9ebd1853ab95 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:17.316820 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-43126009-0044-4821-a89d-9ebd1853ab95 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:17.317336 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-43126009-0044-4821-a89d-9ebd1853ab95 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:17.318371 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-43126009-0044-4821-a89d-9ebd1853ab95 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:17.319046 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-43126009-0044-4821-a89d-9ebd1853ab95 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:17.396204 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-43126009-0044-4821-a89d-9ebd1853ab95 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] HTTP exception thrown: Instance 1e0298bd-7166-4b67-acf1-794621e95cdf is not attached to volume 3c5f7867-5cca-4b95-979a-60df47a25fbb May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-43126009-0044-4821-a89d-9ebd1853ab95 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Request method failure captured: May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: DELETE /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/os-volume_attachments/3c5f7867-5cca-4b95-979a-60df47a25fbb HTTP/1.1 May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqGFoHHoG9Np8X2tgMVc3K0ypjl7mO-jfs9TYzqS7E6hNQidSqpeYqb4HHZ0la8Jb5AEMvr7hr_6NGihYdnjzhSG-3Rdl9JqAR-uxA_7fOsZgv-D5Q3Kon9P7a85_dSrHOB9awjEIgFmlVsKODcoEgubKx-kFjtyK2i-joTQrBpPlx8 May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: 84949fef3a77459fbf02d0804bafdc4a May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-TestMinimumBasicScenario-60298331 May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:13:17.410983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:13:17.412486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/84949fef3a77459fbf02d0804bafdc4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/84949fef3a77459fbf02d0804bafdc4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/84949fef3a77459fbf02d0804bafdc4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_84949fef3a77459fbf02d0804bafdc4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:13:17.412486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-TestMinimumBasicScenario-60298331 May 16 19:13:17.412486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: 84949fef3a77459fbf02d0804bafdc4a May 16 19:13:17.412486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-TestMinimumBasicScenario-60298331 May 16 19:13:17.412486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-TestMinimumBasicScenario-60298331-project May 16 19:13:17.412486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:13:17.412486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:13:17.412486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 2aba8a58b6c24e548a8ab08cfa5bb857 May 16 19:13:17.412486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-TestMinimumBasicScenario-60298331-project May 16 19:13:17.412486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:13:17.412486 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance 1e0298bd-7166-4b67-acf1-794621e95cdf is not attached to volume 3c5f7867-5cca-4b95-979a-60df47a25fbb May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'server_id': '1e0298bd-7166-4b67-acf1-794621e95cdf', 'id': '3c5f7867-5cca-4b95-979a-60df47a25fbb'} May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3c5f7867-5cca-4b95-979a-60df47a25fbb. May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:13:17.413472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:13:17.414932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:13:17.414932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 16 19:13:17.414932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 16 19:13:17.414932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e0298bd-7166-4b67-acf1-794621e95cdf is not attached to volume 3c5f7867-5cca-4b95-979a-60df47a25fbb May 16 19:13:17.414932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:17.414932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:13:17.414932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:17.414932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:17.414932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:13:17.414932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:13:17.414932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:13:17.414932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:13:17.414932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0298bd-7166-4b67-acf1-794621e95cdf is not attached to volume 3c5f7867-5cca-4b95-979a-60df47a25fbb May 16 19:13:17.414932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:17.414932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-43126009-0044-4821-a89d-9ebd1853ab95 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Returning 404 to user: Instance 1e0298bd-7166-4b67-acf1-794621e95cdf is not attached to volume 3c5f7867-5cca-4b95-979a-60df47a25fbb {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:13:17.416024 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-43126009-0044-4821-a89d-9ebd1853ab95 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "DELETE /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/os-volume_attachments/3c5f7867-5cca-4b95-979a-60df47a25fbb" status: 404 len: 154 microversion: 2.1 time: 0.112014 May 16 19:13:17.417391 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 385/787] 10.222.0.24 () {58 vars in 1415 bytes} [Mon May 16 19:13:17 2022] DELETE /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf/os-volume_attachments/3c5f7867-5cca-4b95-979a-60df47a25fbb => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:13:17.474480 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b3e603bd-b714-42e0-b33f-0878ed71d8f2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:17.475096 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b3e603bd-b714-42e0-b33f-0878ed71d8f2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:17.481048 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b3e603bd-b714-42e0-b33f-0878ed71d8f2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:17.481497 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b3e603bd-b714-42e0-b33f-0878ed71d8f2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:17.482308 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b3e603bd-b714-42e0-b33f-0878ed71d8f2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:17.482736 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b3e603bd-b714-42e0-b33f-0878ed71d8f2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:17.617871 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b3e603bd-b714-42e0-b33f-0878ed71d8f2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:17.626402 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b3e603bd-b714-42e0-b33f-0878ed71d8f2 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1735 microversion: 2.1 time: 0.156918 May 16 19:13:17.627039 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 403/788] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:17 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:17.629335 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-da356298-0ca1-42cd-91c4-065aca947f7f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:17.630170 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-da356298-0ca1-42cd-91c4-065aca947f7f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:17.633244 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7d544368-bc2c-4b37-bd23-ff2fcaab5d68 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:17.634212 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7d544368-bc2c-4b37-bd23-ff2fcaab5d68 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:17.636777 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-da356298-0ca1-42cd-91c4-065aca947f7f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:17.637394 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-da356298-0ca1-42cd-91c4-065aca947f7f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:17.638351 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-da356298-0ca1-42cd-91c4-065aca947f7f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:17.638770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-da356298-0ca1-42cd-91c4-065aca947f7f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:17.640686 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7d544368-bc2c-4b37-bd23-ff2fcaab5d68 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:17.641188 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7d544368-bc2c-4b37-bd23-ff2fcaab5d68 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:17.642180 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7d544368-bc2c-4b37-bd23-ff2fcaab5d68 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:17.642664 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7d544368-bc2c-4b37-bd23-ff2fcaab5d68 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:17.853389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7d544368-bc2c-4b37-bd23-ff2fcaab5d68 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:17.863234 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7d544368-bc2c-4b37-bd23-ff2fcaab5d68 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:17.864732 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7d544368-bc2c-4b37-bd23-ff2fcaab5d68 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:17.865872 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7d544368-bc2c-4b37-bd23-ff2fcaab5d68 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1407 microversion: 2.20 time: 0.237055 May 16 19:13:17.866911 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 404/789] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:17 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:13:18.067932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-da356298-0ca1-42cd-91c4-065aca947f7f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:18.080984 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-da356298-0ca1-42cd-91c4-065aca947f7f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1672 microversion: 2.1 time: 0.452420 May 16 19:13:18.081641 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 386/790] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:17 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1672 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:18.470881 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-9be7ba8f-c4a4-4b68-8d87-5a56d1606c69 req-886acebd-bee4-45a2-968e-afe7d648571c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a68fcd6b-1593-4fd4-8915-3153f52105c1", "name": "network-vif-deleted", "tag": "f100112e-7e29-4339-bff0-b6f0d938007d"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:18.479662 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-9be7ba8f-c4a4-4b68-8d87-5a56d1606c69 req-886acebd-bee4-45a2-968e-afe7d648571c service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:18.480222 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-9be7ba8f-c4a4-4b68-8d87-5a56d1606c69 req-886acebd-bee4-45a2-968e-afe7d648571c service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:18.492173 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-9be7ba8f-c4a4-4b68-8d87-5a56d1606c69 req-886acebd-bee4-45a2-968e-afe7d648571c service nova] Creating event network-vif-deleted:f100112e-7e29-4339-bff0-b6f0d938007d for instance a68fcd6b-1593-4fd4-8915-3153f52105c1 on hv-cinder-76606 May 16 19:13:18.497353 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-9be7ba8f-c4a4-4b68-8d87-5a56d1606c69 req-886acebd-bee4-45a2-968e-afe7d648571c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030101 May 16 19:13:18.497995 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 405/791] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:18.552479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e8db1446-4ac3-4064-9a61-e478263328f7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:18.553739 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e8db1446-4ac3-4064-9a61-e478263328f7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:18.561247 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e8db1446-4ac3-4064-9a61-e478263328f7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:18.561723 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e8db1446-4ac3-4064-9a61-e478263328f7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:18.562543 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e8db1446-4ac3-4064-9a61-e478263328f7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:18.562972 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e8db1446-4ac3-4064-9a61-e478263328f7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:18.589417 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e8db1446-4ac3-4064-9a61-e478263328f7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Going to try to terminate instance {{(pid=117275) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:13:18.647933 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9cf7488b-2c30-4fd3-97bf-d8da08e34d68 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:18.648557 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9cf7488b-2c30-4fd3-97bf-d8da08e34d68 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:18.656740 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9cf7488b-2c30-4fd3-97bf-d8da08e34d68 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:18.657612 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9cf7488b-2c30-4fd3-97bf-d8da08e34d68 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:18.658815 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9cf7488b-2c30-4fd3-97bf-d8da08e34d68 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:18.659421 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9cf7488b-2c30-4fd3-97bf-d8da08e34d68 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:18.679335 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e8db1446-4ac3-4064-9a61-e478263328f7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "DELETE /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 204 len: 0 microversion: 2.1 time: 0.130093 May 16 19:13:18.680248 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 387/792] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:13:18 2022] DELETE /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 19:13:18.701921 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ff0de99f-7395-4c5c-8a59-96e1d7308451 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:18.708507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ff0de99f-7395-4c5c-8a59-96e1d7308451 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:18.725708 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ff0de99f-7395-4c5c-8a59-96e1d7308451 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:18.727351 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ff0de99f-7395-4c5c-8a59-96e1d7308451 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:18.728869 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ff0de99f-7395-4c5c-8a59-96e1d7308451 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:18.729740 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ff0de99f-7395-4c5c-8a59-96e1d7308451 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:18.812274 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9cf7488b-2c30-4fd3-97bf-d8da08e34d68 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:18.820537 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9cf7488b-2c30-4fd3-97bf-d8da08e34d68 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1715 microversion: 2.1 time: 0.180399 May 16 19:13:18.821118 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 406/793] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:18 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1715 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:18.876881 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ff0de99f-7395-4c5c-8a59-96e1d7308451 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:18.884217 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a997506d-ff3f-4316-98b6-385b2d6efc0d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:18.884925 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a997506d-ff3f-4316-98b6-385b2d6efc0d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:18.886097 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ff0de99f-7395-4c5c-8a59-96e1d7308451 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1554 microversion: 2.1 time: 0.201302 May 16 19:13:18.886988 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 388/794] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:18 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1554 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:13:18.892053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a997506d-ff3f-4316-98b6-385b2d6efc0d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:18.894025 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a997506d-ff3f-4316-98b6-385b2d6efc0d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:18.895003 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a997506d-ff3f-4316-98b6-385b2d6efc0d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:18.895595 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a997506d-ff3f-4316-98b6-385b2d6efc0d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:18.961173 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c99b9a72-b4ac-4332-9de4-dd09399ea314 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:18.961742 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c99b9a72-b4ac-4332-9de4-dd09399ea314 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:18.968234 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c99b9a72-b4ac-4332-9de4-dd09399ea314 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:18.968682 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c99b9a72-b4ac-4332-9de4-dd09399ea314 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:18.969466 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c99b9a72-b4ac-4332-9de4-dd09399ea314 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:18.969957 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c99b9a72-b4ac-4332-9de4-dd09399ea314 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:19.061927 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a997506d-ff3f-4316-98b6-385b2d6efc0d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:19.070592 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a997506d-ff3f-4316-98b6-385b2d6efc0d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:19.071697 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-c99b9a72-b4ac-4332-9de4-dd09399ea314 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] HTTP exception thrown: Cannot 'detach_volume' instance eeb4d6c5-966a-44b0-a092-602b55ec665c while it is in vm_state rescued May 16 19:13:19.072303 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a997506d-ff3f-4316-98b6-385b2d6efc0d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c99b9a72-b4ac-4332-9de4-dd09399ea314 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Request method failure captured: May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: DELETE /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/os-volume_attachments/cd21ee13-a791-4160-b7f2-11b738849ebf HTTP/1.1 May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqEpTPlBWWpGAb8naoUtmT0kghhiI3kimMzn0_IWG3sCJkSvB5xO-7IGvOFSSINkqC-urNwmtwl2u96aKU3xl-Dex2fmV-bVO4ktBC40rbYPJQDH7eWDNSupKRIkwS3ds8fzriCvEWSDHbsHMvvS0L95hwszzciSeDbpHSrW4xtsOro May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: ba2c6e5fee5b402fa68833228d12c8e7 May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-949694738 May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:13:19.073372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:13:19.085156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:13:19.085156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-ServerRescueNegativeTestJSON-949694738 May 16 19:13:19.085156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: ba2c6e5fee5b402fa68833228d12c8e7 May 16 19:13:19.085156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-949694738 May 16 19:13:19.085156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-ServerRescueNegativeTestJSON-949694738-project May 16 19:13:19.085156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:13:19.085156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:13:19.085156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 1673e91c8910435499a5d587f4ef59f9 May 16 19:13:19.085156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-ServerRescueNegativeTestJSON-949694738-project May 16 19:13:19.085156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:13:19.085156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Cannot 'detach_volume' instance eeb4d6c5-966a-44b0-a092-602b55ec665c while it is in vm_state rescued May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'server_id': 'eeb4d6c5-966a-44b0-a092-602b55ec665c', 'id': 'cd21ee13-a791-4160-b7f2-11b738849ebf'} May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eeb4d6c5-966a-44b0-a092-602b55ec665c in vm_state rescued. Cannot detach_volume while the instance is in this state. May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:13:19.085874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:13:19.087043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 16 19:13:19.087043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 19:13:19.087043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 19:13:19.087043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 19:13:19.087043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance eeb4d6c5-966a-44b0-a092-602b55ec665c while it is in vm_state rescued May 16 19:13:19.087043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:19.087043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:13:19.087043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:19.087043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:19.087043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:13:19.087043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:13:19.087043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:13:19.087043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:13:19.087043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance eeb4d6c5-966a-44b0-a092-602b55ec665c while it is in vm_state rescued May 16 19:13:19.087043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:19.087944 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a997506d-ff3f-4316-98b6-385b2d6efc0d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1407 microversion: 2.20 time: 0.193253 May 16 19:13:19.088025 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c99b9a72-b4ac-4332-9de4-dd09399ea314 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Returning 409 to user: Cannot 'detach_volume' instance eeb4d6c5-966a-44b0-a092-602b55ec665c while it is in vm_state rescued {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:13:19.088101 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 407/795] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:18 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:13:19.088190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c99b9a72-b4ac-4332-9de4-dd09399ea314 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "DELETE /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/os-volume_attachments/cd21ee13-a791-4160-b7f2-11b738849ebf" status: 409 len: 152 microversion: 2.1 time: 0.120588 May 16 19:13:19.088190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 389/796] 10.222.0.24 () {58 vars in 1415 bytes} [Mon May 16 19:13:18 2022] DELETE /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/os-volume_attachments/cd21ee13-a791-4160-b7f2-11b738849ebf => generated 152 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 16 19:13:19.088340 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0532f702-68b4-4ea9-b006-e50ade5598c8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:19.088340 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0532f702-68b4-4ea9-b006-e50ade5598c8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:19.091581 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0532f702-68b4-4ea9-b006-e50ade5598c8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:19.093328 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0532f702-68b4-4ea9-b006-e50ade5598c8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:19.093328 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0532f702-68b4-4ea9-b006-e50ade5598c8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:19.093328 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0532f702-68b4-4ea9-b006-e50ade5598c8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:19.100324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-21272765-797e-44ee-bdcc-4fd3cdc23233 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:19.100927 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-21272765-797e-44ee-bdcc-4fd3cdc23233 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:19.109840 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-21272765-797e-44ee-bdcc-4fd3cdc23233 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:19.110293 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-21272765-797e-44ee-bdcc-4fd3cdc23233 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:19.111090 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-21272765-797e-44ee-bdcc-4fd3cdc23233 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:19.111529 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-21272765-797e-44ee-bdcc-4fd3cdc23233 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:19.176922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-21272765-797e-44ee-bdcc-4fd3cdc23233 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:19.183759 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0532f702-68b4-4ea9-b006-e50ade5598c8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "POST /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/action" status: 202 len: 0 microversion: 2.1 time: 0.103718 May 16 19:13:19.185122 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 408/797] 10.222.0.24 () {60 vars in 1277 bytes} [Mon May 16 19:13:19 2022] POST /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 19:13:19.185561 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-21272765-797e-44ee-bdcc-4fd3cdc23233 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1321 microversion: 2.1 time: 0.090923 May 16 19:13:19.186200 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 390/798] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:19 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1321 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:19.190721 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-0910f9f8-cbff-43d8-9739-db3685bbc292 req-264e39f8-1abe-467c-8eb1-fb786b8f6a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a68fcd6b-1593-4fd4-8915-3153f52105c1", "name": "network-vif-unplugged", "status": "completed", "tag": "f100112e-7e29-4339-bff0-b6f0d938007d"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:19.192757 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-24d2ef03-85db-4c07-b85a-7e846fff0e67 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:19.193345 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-24d2ef03-85db-4c07-b85a-7e846fff0e67 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:19.199780 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-0910f9f8-cbff-43d8-9739-db3685bbc292 req-264e39f8-1abe-467c-8eb1-fb786b8f6a2a service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:19.199991 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-24d2ef03-85db-4c07-b85a-7e846fff0e67 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:19.200268 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-24d2ef03-85db-4c07-b85a-7e846fff0e67 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:19.200648 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-0910f9f8-cbff-43d8-9739-db3685bbc292 req-264e39f8-1abe-467c-8eb1-fb786b8f6a2a service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:19.201049 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-24d2ef03-85db-4c07-b85a-7e846fff0e67 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:19.201516 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-24d2ef03-85db-4c07-b85a-7e846fff0e67 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:19.212316 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-0910f9f8-cbff-43d8-9739-db3685bbc292 req-264e39f8-1abe-467c-8eb1-fb786b8f6a2a service nova] Creating event network-vif-unplugged:f100112e-7e29-4339-bff0-b6f0d938007d for instance a68fcd6b-1593-4fd4-8915-3153f52105c1 on hv-cinder-76606 May 16 19:13:19.217596 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-0910f9f8-cbff-43d8-9739-db3685bbc292 req-264e39f8-1abe-467c-8eb1-fb786b8f6a2a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031007 May 16 19:13:19.218267 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 409/799] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:19.338422 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-24d2ef03-85db-4c07-b85a-7e846fff0e67 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:19.346770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-24d2ef03-85db-4c07-b85a-7e846fff0e67 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1723 microversion: 2.1 time: 0.157864 May 16 19:13:19.347358 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 391/800] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:19 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:19.908927 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b78302a1-bf33-45b8-98ef-72c8dbc63a17 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:19.910135 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b78302a1-bf33-45b8-98ef-72c8dbc63a17 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:19.920947 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b78302a1-bf33-45b8-98ef-72c8dbc63a17 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:19.921742 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b78302a1-bf33-45b8-98ef-72c8dbc63a17 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:19.923024 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b78302a1-bf33-45b8-98ef-72c8dbc63a17 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:19.923786 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b78302a1-bf33-45b8-98ef-72c8dbc63a17 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:20.068117 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b78302a1-bf33-45b8-98ef-72c8dbc63a17 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:20.076431 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b78302a1-bf33-45b8-98ef-72c8dbc63a17 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1554 microversion: 2.1 time: 0.175403 May 16 19:13:20.077110 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 410/801] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:19 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:20.093036 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-73bb9dc3-d142-4ecd-872f-5cecb7177c80 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:20.093797 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-73bb9dc3-d142-4ecd-872f-5cecb7177c80 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:20.100687 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-73bb9dc3-d142-4ecd-872f-5cecb7177c80 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:20.101137 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-73bb9dc3-d142-4ecd-872f-5cecb7177c80 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:20.101946 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-73bb9dc3-d142-4ecd-872f-5cecb7177c80 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:20.102384 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-73bb9dc3-d142-4ecd-872f-5cecb7177c80 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:20.202652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-3893a9dc-c35c-46e0-b140-7210303811d8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:20.203255 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-3893a9dc-c35c-46e0-b140-7210303811d8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:20.209167 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3893a9dc-c35c-46e0-b140-7210303811d8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:20.209638 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3893a9dc-c35c-46e0-b140-7210303811d8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:20.210455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3893a9dc-c35c-46e0-b140-7210303811d8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:20.210879 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3893a9dc-c35c-46e0-b140-7210303811d8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:20.236758 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-73bb9dc3-d142-4ecd-872f-5cecb7177c80 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:20.244710 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-73bb9dc3-d142-4ecd-872f-5cecb7177c80 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:20.246226 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-73bb9dc3-d142-4ecd-872f-5cecb7177c80 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:20.247323 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-73bb9dc3-d142-4ecd-872f-5cecb7177c80 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1407 microversion: 2.20 time: 0.159375 May 16 19:13:20.247879 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 392/802] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:20 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:13:20.276554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-3893a9dc-c35c-46e0-b140-7210303811d8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:20.287761 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-3893a9dc-c35c-46e0-b140-7210303811d8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1321 microversion: 2.1 time: 0.088549 May 16 19:13:20.288599 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 411/803] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:20 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1321 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:13:20.368981 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b4c0b77b-7073-4521-bd8c-90c1dad91939 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:20.370037 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b4c0b77b-7073-4521-bd8c-90c1dad91939 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:20.380066 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b4c0b77b-7073-4521-bd8c-90c1dad91939 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:20.380798 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b4c0b77b-7073-4521-bd8c-90c1dad91939 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:20.382170 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b4c0b77b-7073-4521-bd8c-90c1dad91939 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:20.382583 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b4c0b77b-7073-4521-bd8c-90c1dad91939 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:20.522899 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b4c0b77b-7073-4521-bd8c-90c1dad91939 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:20.531673 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b4c0b77b-7073-4521-bd8c-90c1dad91939 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1723 microversion: 2.1 time: 0.169668 May 16 19:13:20.532334 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 393/804] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:20 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:21.094251 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8c683c34-df67-4316-bbf3-756c7607742b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:21.094869 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8c683c34-df67-4316-bbf3-756c7607742b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:21.101568 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c683c34-df67-4316-bbf3-756c7607742b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:21.102055 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c683c34-df67-4316-bbf3-756c7607742b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:21.102827 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c683c34-df67-4316-bbf3-756c7607742b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:21.103258 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c683c34-df67-4316-bbf3-756c7607742b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:21.235997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-8c683c34-df67-4316-bbf3-756c7607742b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:21.244062 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8c683c34-df67-4316-bbf3-756c7607742b tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1554 microversion: 2.1 time: 0.153765 May 16 19:13:21.244762 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 412/805] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:21 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:13:21.265990 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b57b6366-0a8d-42bb-b3b5-3bf50d19c4c6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:21.266650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b57b6366-0a8d-42bb-b3b5-3bf50d19c4c6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:21.273741 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b57b6366-0a8d-42bb-b3b5-3bf50d19c4c6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:21.274326 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b57b6366-0a8d-42bb-b3b5-3bf50d19c4c6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:21.275086 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b57b6366-0a8d-42bb-b3b5-3bf50d19c4c6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:21.275548 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b57b6366-0a8d-42bb-b3b5-3bf50d19c4c6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:21.307048 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-df0eb2d9-e866-41ba-9fd0-c8f38e8cf85c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:21.307739 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-df0eb2d9-e866-41ba-9fd0-c8f38e8cf85c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:21.313839 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-df0eb2d9-e866-41ba-9fd0-c8f38e8cf85c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:21.314288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-df0eb2d9-e866-41ba-9fd0-c8f38e8cf85c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:21.315150 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-df0eb2d9-e866-41ba-9fd0-c8f38e8cf85c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:21.315669 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-df0eb2d9-e866-41ba-9fd0-c8f38e8cf85c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:21.354140 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-df0eb2d9-e866-41ba-9fd0-c8f38e8cf85c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:21.358000 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-df0eb2d9-e866-41ba-9fd0-c8f38e8cf85c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:21.358000 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-df0eb2d9-e866-41ba-9fd0-c8f38e8cf85c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lazy-loading 'fault' on Instance uuid a68fcd6b-1593-4fd4-8915-3153f52105c1 {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:13:21.405227 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-df0eb2d9-e866-41ba-9fd0-c8f38e8cf85c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:21.413048 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-df0eb2d9-e866-41ba-9fd0-c8f38e8cf85c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 200 len: 1326 microversion: 2.1 time: 0.110278 May 16 19:13:21.413894 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 413/806] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:21 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 1326 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:13:21.430499 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b57b6366-0a8d-42bb-b3b5-3bf50d19c4c6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:21.438311 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b57b6366-0a8d-42bb-b3b5-3bf50d19c4c6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:21.439805 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b57b6366-0a8d-42bb-b3b5-3bf50d19c4c6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:21.440966 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b57b6366-0a8d-42bb-b3b5-3bf50d19c4c6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1599 microversion: 2.20 time: 0.179101 May 16 19:13:21.441561 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 394/807] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:13:21 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1599 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:13:21.458173 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-6b46f0a1-10b8-4c29-b878-b1e636f2691c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:21.458661 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-6b46f0a1-10b8-4c29-b878-b1e636f2691c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:21.464822 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6b46f0a1-10b8-4c29-b878-b1e636f2691c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:21.465262 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6b46f0a1-10b8-4c29-b878-b1e636f2691c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:21.466078 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6b46f0a1-10b8-4c29-b878-b1e636f2691c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:21.466669 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6b46f0a1-10b8-4c29-b878-b1e636f2691c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:21.546595 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-6b46f0a1-10b8-4c29-b878-b1e636f2691c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092297 May 16 19:13:21.547777 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 414/808] 10.222.0.24 () {60 vars in 1315 bytes} [Mon May 16 19:13:21 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:13:21.550759 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-020d65b6-5148-4c19-8e88-f1260878bcb3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:21.551761 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-020d65b6-5148-4c19-8e88-f1260878bcb3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:21.569905 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-020d65b6-5148-4c19-8e88-f1260878bcb3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:21.570780 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-020d65b6-5148-4c19-8e88-f1260878bcb3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:21.571940 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-020d65b6-5148-4c19-8e88-f1260878bcb3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:21.573163 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-020d65b6-5148-4c19-8e88-f1260878bcb3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:22.098052 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-020d65b6-5148-4c19-8e88-f1260878bcb3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:22.106310 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-020d65b6-5148-4c19-8e88-f1260878bcb3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1723 microversion: 2.1 time: 0.560698 May 16 19:13:22.106885 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 395/809] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:21 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1723 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:22.262046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a43b676b-2dda-4884-b63f-214f70730b68 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:22.263047 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a43b676b-2dda-4884-b63f-214f70730b68 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:22.270065 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a43b676b-2dda-4884-b63f-214f70730b68 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:22.270515 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a43b676b-2dda-4884-b63f-214f70730b68 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:22.271675 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a43b676b-2dda-4884-b63f-214f70730b68 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:22.272121 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a43b676b-2dda-4884-b63f-214f70730b68 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:22.406773 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a43b676b-2dda-4884-b63f-214f70730b68 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:22.415358 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a43b676b-2dda-4884-b63f-214f70730b68 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1554 microversion: 2.1 time: 0.157721 May 16 19:13:22.416007 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 415/810] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:22 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:22.431666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-faef3942-8b9a-4270-a2f5-970694060048 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:22.432379 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-faef3942-8b9a-4270-a2f5-970694060048 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:22.439969 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-faef3942-8b9a-4270-a2f5-970694060048 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:22.440542 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-faef3942-8b9a-4270-a2f5-970694060048 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:22.441852 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-faef3942-8b9a-4270-a2f5-970694060048 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:22.442211 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-faef3942-8b9a-4270-a2f5-970694060048 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:22.458223 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-faef3942-8b9a-4270-a2f5-970694060048 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] HTTP exception thrown: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-faef3942-8b9a-4270-a2f5-970694060048 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Request method failure captured: May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 HTTP/1.1 May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqEZT6mTo_UphwI-EfWeAkahjxL1N0So-0jfzNSPYzjEpUMPTGhnIis0D_rwIe2FEGmyrwMMK9eYEBibQ_bcX4zwG9OoHY5E_Se69-u9zYer_gQQbFt5rZXRE17-C2ehMmwYw-JcTsVqxaArPwAtqZlbknUg_4KIa5nmydhc60e9-8U May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: dee1963e977f4ac7b6d1877a6dd740a9 May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-AttachVolumeTestJSON-1533894289 May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:13:22.459973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:13:22.461551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:13:22.461551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-AttachVolumeTestJSON-1533894289 May 16 19:13:22.461551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: dee1963e977f4ac7b6d1877a6dd740a9 May 16 19:13:22.461551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1533894289 May 16 19:13:22.461551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-AttachVolumeTestJSON-1533894289-project May 16 19:13:22.461551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:13:22.461551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:13:22.461551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: a7d2aea046214bfcbbe6d5b3581fc155 May 16 19:13:22.461551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-AttachVolumeTestJSON-1533894289-project May 16 19:13:22.461551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:13:22.461551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. May 16 19:13:22.461551 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': 'a68fcd6b-1593-4fd4-8915-3153f52105c1'} May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:13:22.462585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. May 16 19:13:22.463983 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:22.466310 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-faef3942-8b9a-4270-a2f5-970694060048 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Returning 404 to user: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:13:22.467342 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-faef3942-8b9a-4270-a2f5-970694060048 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 404 len: 111 microversion: 2.1 time: 0.039934 May 16 19:13:22.468552 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 396/811] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:22 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:13:22.477185 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-78324255-a118-4068-8793-79b985567745 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '.version_select at 0x7f1e184adaf0>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:22.497073 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-78324255-a118-4068-8793-79b985567745 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-710375608" status: 202 len: 0 microversion: 2.1 time: 0.023720 May 16 19:13:22.498197 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 416/812] 10.222.0.24 () {58 vars in 1217 bytes} [Mon May 16 19:13:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-710375608 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:13:23.126474 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7b3d0491-01ad-48c5-b440-460d152c741d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:23.127139 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7b3d0491-01ad-48c5-b440-460d152c741d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:23.128370 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f5b47d6c-9ea7-435a-8dd9-78516459f69f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Action: 'create', calling method: .version_select at 0x7f1e0bd995e0>, body: {"keypair": {"name": "tempest-keypair-943070771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeIzUT/3oJyjIybLlKUfVmdp9wgbW7jyZ3Dz0RgEht5Rex3Ilt6KC2G4OP+IWE1+Ap5CwgUbgNhNSjox/LyY4bxCm3DWLPc+U6UBmdZZxzd1ecSw5wDz0RIefCziHYWow=="}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:23.134097 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7b3d0491-01ad-48c5-b440-460d152c741d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:23.134543 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7b3d0491-01ad-48c5-b440-460d152c741d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:23.135377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7b3d0491-01ad-48c5-b440-460d152c741d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:23.135803 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7b3d0491-01ad-48c5-b440-460d152c741d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:23.143460 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-f5b47d6c-9ea7-435a-8dd9-78516459f69f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Getting quotas for project dee1963e977f4ac7b6d1877a6dd740a9. Resources: {'key_pairs'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:13:23.147999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-f5b47d6c-9ea7-435a-8dd9-78516459f69f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Getting quotas for user a7d2aea046214bfcbbe6d5b3581fc155 and project dee1963e977f4ac7b6d1877a6dd740a9. Resources: {'key_pairs'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:13:23.173787 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f5b47d6c-9ea7-435a-8dd9-78516459f69f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051105 May 16 19:13:23.174478 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 397/813] 10.222.0.24 () {60 vars in 1158 bytes} [Mon May 16 19:13:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:23.316399 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7b3d0491-01ad-48c5-b440-460d152c741d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:23.325728 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7b3d0491-01ad-48c5-b440-460d152c741d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1723 microversion: 2.1 time: 0.203050 May 16 19:13:23.326633 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 417/814] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:23 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:23.434892 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-14a9939d-dc15-42a9-9eb5-934b34ea54dc tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:23.435531 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-14a9939d-dc15-42a9-9eb5-934b34ea54dc tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:23.443001 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-14a9939d-dc15-42a9-9eb5-934b34ea54dc tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:23.443439 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-14a9939d-dc15-42a9-9eb5-934b34ea54dc tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:23.444184 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-14a9939d-dc15-42a9-9eb5-934b34ea54dc tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:23.444852 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-14a9939d-dc15-42a9-9eb5-934b34ea54dc tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:23.852080 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-b02ba7d2-11f0-400f-97b5-eb8bdcd535ef req-2a2fec14-418f-4ae5-8c75-0067a22ad8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0298bd-7166-4b67-acf1-794621e95cdf", "name": "network-vif-deleted", "tag": "12358361-c4bc-4509-98f8-117b7fd4543e"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:23.854354 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-14a9939d-dc15-42a9-9eb5-934b34ea54dc tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:23.862012 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-14a9939d-dc15-42a9-9eb5-934b34ea54dc tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1554 microversion: 2.1 time: 0.432633 May 16 19:13:23.862592 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 398/815] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:23 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1554 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:23.876382 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-b02ba7d2-11f0-400f-97b5-eb8bdcd535ef req-2a2fec14-418f-4ae5-8c75-0067a22ad8ac service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:23.878903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-b02ba7d2-11f0-400f-97b5-eb8bdcd535ef req-2a2fec14-418f-4ae5-8c75-0067a22ad8ac service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:23.904643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-b02ba7d2-11f0-400f-97b5-eb8bdcd535ef req-2a2fec14-418f-4ae5-8c75-0067a22ad8ac service nova] Creating event network-vif-deleted:12358361-c4bc-4509-98f8-117b7fd4543e for instance 1e0298bd-7166-4b67-acf1-794621e95cdf on hv-cinder-76606 May 16 19:13:23.911002 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-b02ba7d2-11f0-400f-97b5-eb8bdcd535ef req-2a2fec14-418f-4ae5-8c75-0067a22ad8ac service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065339 May 16 19:13:23.912153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 418/816] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:13:24.343603 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f02c5097-9e08-4629-9398-3e561c1a8a0d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:24.344590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f02c5097-9e08-4629-9398-3e561c1a8a0d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:24.352018 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f02c5097-9e08-4629-9398-3e561c1a8a0d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:24.352663 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f02c5097-9e08-4629-9398-3e561c1a8a0d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:24.353682 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f02c5097-9e08-4629-9398-3e561c1a8a0d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:24.354314 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f02c5097-9e08-4629-9398-3e561c1a8a0d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:24.498208 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f02c5097-9e08-4629-9398-3e561c1a8a0d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:24.509264 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f02c5097-9e08-4629-9398-3e561c1a8a0d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1723 microversion: 2.1 time: 0.169723 May 16 19:13:24.520020 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 399/817] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:24 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:24.883224 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-99245470-a15e-4188-8440-50806edddcf7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:24.884732 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-99245470-a15e-4188-8440-50806edddcf7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:24.891609 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-99245470-a15e-4188-8440-50806edddcf7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:24.892307 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-99245470-a15e-4188-8440-50806edddcf7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:24.893257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-99245470-a15e-4188-8440-50806edddcf7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:24.893974 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-99245470-a15e-4188-8440-50806edddcf7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:25.032835 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-99245470-a15e-4188-8440-50806edddcf7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:25.042698 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-99245470-a15e-4188-8440-50806edddcf7 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1343 microversion: 2.1 time: 0.166521 May 16 19:13:25.043850 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 419/818] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:24 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1343 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:25.443972 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8eda0b18-5e15-4b23-8f7f-3551ce1b650b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-707655625", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5657b193-1d9d-4ab0-bc85-4249fb974f7c"}], "security_groups": [{"name": "tempest-securitygroup--1792300921"}], "key_name": "tempest-keypair-943070771", "user_data": "}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:25.527717 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7b4f6532-0c93-471a-a9d6-0ab8a2c452fa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:25.528572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7b4f6532-0c93-471a-a9d6-0ab8a2c452fa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:25.534511 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7b4f6532-0c93-471a-a9d6-0ab8a2c452fa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:25.535155 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7b4f6532-0c93-471a-a9d6-0ab8a2c452fa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:25.536111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7b4f6532-0c93-471a-a9d6-0ab8a2c452fa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:25.536705 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7b4f6532-0c93-471a-a9d6-0ab8a2c452fa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:25.557812 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.network.neutron [None req-8eda0b18-5e15-4b23-8f7f-3551ce1b650b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] validate_networks() for [('5657b193-1d9d-4ab0-bc85-4249fb974f7c', None, None, None, None, None)] {{(pid=117275) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:13:25.706442 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7b4f6532-0c93-471a-a9d6-0ab8a2c452fa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:25.714402 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7b4f6532-0c93-471a-a9d6-0ab8a2c452fa tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1723 microversion: 2.1 time: 0.190793 May 16 19:13:25.715191 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 420/819] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:25 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:25.929881 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-756bdeb8-9c34-4d08-be78-f26482d20928 req-812a72c4-c060-46bf-962f-804f03fc879c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b664a08c-f97e-4c52-b849-9eddb2e65be5", "tag": "34940ecb-c2a4-45ca-ad50-7ea9f112b22a"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:25.938918 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-756bdeb8-9c34-4d08-be78-f26482d20928 req-812a72c4-c060-46bf-962f-804f03fc879c service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:25.939452 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-756bdeb8-9c34-4d08-be78-f26482d20928 req-812a72c4-c060-46bf-962f-804f03fc879c service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:25.951321 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-756bdeb8-9c34-4d08-be78-f26482d20928 req-812a72c4-c060-46bf-962f-804f03fc879c service nova] Creating event network-changed:34940ecb-c2a4-45ca-ad50-7ea9f112b22a for instance b664a08c-f97e-4c52-b849-9eddb2e65be5 on hv-cinder-76606 May 16 19:13:25.956574 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-756bdeb8-9c34-4d08-be78-f26482d20928 req-812a72c4-c060-46bf-962f-804f03fc879c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030522 May 16 19:13:25.957263 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 421/820] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:26.061048 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e175d517-a611-4537-b5c7-7d3375a6415f tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:26.061807 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e175d517-a611-4537-b5c7-7d3375a6415f tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:26.069014 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e175d517-a611-4537-b5c7-7d3375a6415f tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:26.069500 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e175d517-a611-4537-b5c7-7d3375a6415f tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:26.070563 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e175d517-a611-4537-b5c7-7d3375a6415f tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:26.070999 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e175d517-a611-4537-b5c7-7d3375a6415f tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:26.120460 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e175d517-a611-4537-b5c7-7d3375a6415f tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:26.121074 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e175d517-a611-4537-b5c7-7d3375a6415f tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:26.121811 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-e175d517-a611-4537-b5c7-7d3375a6415f tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lazy-loading 'fault' on Instance uuid 1e0298bd-7166-4b67-acf1-794621e95cdf {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:13:26.171376 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e175d517-a611-4537-b5c7-7d3375a6415f tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aba8a58b6c24e548a8ab08cfa5bb857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84949fef3a77459fbf02d0804bafdc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:26.180248 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e175d517-a611-4537-b5c7-7d3375a6415f tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 200 len: 1348 microversion: 2.1 time: 0.123409 May 16 19:13:26.180876 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 422/821] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:26 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 1348 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:26.334630 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-8eda0b18-5e15-4b23-8f7f-3551ce1b650b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Flavor limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:13:26.335055 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-8eda0b18-5e15-4b23-8f7f-3551ce1b650b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Image limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:13:26.335536 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-8eda0b18-5e15-4b23-8f7f-3551ce1b650b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Flavor pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:13:26.335988 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-8eda0b18-5e15-4b23-8f7f-3551ce1b650b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Image pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:13:26.336492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-8eda0b18-5e15-4b23-8f7f-3551ce1b650b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:13:26.346199 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8eda0b18-5e15-4b23-8f7f-3551ce1b650b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:26.346650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8eda0b18-5e15-4b23-8f7f-3551ce1b650b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:26.347460 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8eda0b18-5e15-4b23-8f7f-3551ce1b650b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:26.347898 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8eda0b18-5e15-4b23-8f7f-3551ce1b650b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:26.365223 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-8eda0b18-5e15-4b23-8f7f-3551ce1b650b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Getting quotas for project dee1963e977f4ac7b6d1877a6dd740a9. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:13:26.369556 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-8eda0b18-5e15-4b23-8f7f-3551ce1b650b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Getting quotas for user a7d2aea046214bfcbbe6d5b3581fc155 and project dee1963e977f4ac7b6d1877a6dd740a9. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:13:26.381379 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8eda0b18-5e15-4b23-8f7f-3551ce1b650b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Going to run 1 instances... {{(pid=117275) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:13:26.383915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8eda0b18-5e15-4b23-8f7f-3551ce1b650b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:13:26.432321 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8eda0b18-5e15-4b23-8f7f-3551ce1b650b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.992536 May 16 19:13:26.437943 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 400/822] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:13:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:13:26.443421 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2a082105-a273-4ae7-8d51-01a965004821 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:26.444151 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2a082105-a273-4ae7-8d51-01a965004821 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:26.511768 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2a082105-a273-4ae7-8d51-01a965004821 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:26.521117 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2a082105-a273-4ae7-8d51-01a965004821 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1236 microversion: 2.1 time: 0.080987 May 16 19:13:26.530799 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 423/823] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:26 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1236 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:13:26.734505 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9dde3046-632b-4f8b-8a6a-96569bbbaeb8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:26.735893 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9dde3046-632b-4f8b-8a6a-96569bbbaeb8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:26.746834 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9dde3046-632b-4f8b-8a6a-96569bbbaeb8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:26.747637 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9dde3046-632b-4f8b-8a6a-96569bbbaeb8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:26.749639 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9dde3046-632b-4f8b-8a6a-96569bbbaeb8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:26.749639 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9dde3046-632b-4f8b-8a6a-96569bbbaeb8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:26.982995 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-9dde3046-632b-4f8b-8a6a-96569bbbaeb8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:26.994783 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9dde3046-632b-4f8b-8a6a-96569bbbaeb8 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1729 microversion: 2.1 time: 0.266141 May 16 19:13:26.995762 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 401/824] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:26 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1729 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:27.013122 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-48caf454-61d6-44ad-803c-e97340401909 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:27.014211 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-48caf454-61d6-44ad-803c-e97340401909 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:27.021926 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-48caf454-61d6-44ad-803c-e97340401909 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:27.022349 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-48caf454-61d6-44ad-803c-e97340401909 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:27.023236 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-48caf454-61d6-44ad-803c-e97340401909 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:27.023776 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-48caf454-61d6-44ad-803c-e97340401909 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:27.132956 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-48caf454-61d6-44ad-803c-e97340401909 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124678 May 16 19:13:27.133654 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 424/825] 10.222.0.24 () {58 vars in 1274 bytes} [Mon May 16 19:13:27 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:27.198088 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3861f046-68ad-470f-b340-bc3a2f002f53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:27.199120 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-3861f046-68ad-470f-b340-bc3a2f002f53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] [instance: 1e0298bd-7166-4b67-acf1-794621e95cdf] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:27.205984 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3861f046-68ad-470f-b340-bc3a2f002f53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:27.206716 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3861f046-68ad-470f-b340-bc3a2f002f53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:27.208594 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3861f046-68ad-470f-b340-bc3a2f002f53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:27.210037 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3861f046-68ad-470f-b340-bc3a2f002f53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:27.225053 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-3861f046-68ad-470f-b340-bc3a2f002f53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] HTTP exception thrown: Instance 1e0298bd-7166-4b67-acf1-794621e95cdf could not be found. May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3861f046-68ad-470f-b340-bc3a2f002f53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Request method failure captured: May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf HTTP/1.1 May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqGFoHHoG9Np8X2tgMVc3K0ypjl7mO-jfs9TYzqS7E6hNQidSqpeYqb4HHZ0la8Jb5AEMvr7hr_6NGihYdnjzhSG-3Rdl9JqAR-uxA_7fOsZgv-D5Q3Kon9P7a85_dSrHOB9awjEIgFmlVsKODcoEgubKx-kFjtyK2i-joTQrBpPlx8 May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: 84949fef3a77459fbf02d0804bafdc4a May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-TestMinimumBasicScenario-60298331 May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:13:27.226998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:13:27.228522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/84949fef3a77459fbf02d0804bafdc4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/84949fef3a77459fbf02d0804bafdc4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/84949fef3a77459fbf02d0804bafdc4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_84949fef3a77459fbf02d0804bafdc4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:13:27.228522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-TestMinimumBasicScenario-60298331 May 16 19:13:27.228522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: 84949fef3a77459fbf02d0804bafdc4a May 16 19:13:27.228522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-TestMinimumBasicScenario-60298331 May 16 19:13:27.228522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-TestMinimumBasicScenario-60298331-project May 16 19:13:27.228522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:13:27.228522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:13:27.228522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 2aba8a58b6c24e548a8ab08cfa5bb857 May 16 19:13:27.228522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-TestMinimumBasicScenario-60298331-project May 16 19:13:27.228522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:13:27.228522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance 1e0298bd-7166-4b67-acf1-794621e95cdf could not be found. May 16 19:13:27.228522 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': '1e0298bd-7166-4b67-acf1-794621e95cdf'} May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e0298bd-7166-4b67-acf1-794621e95cdf could not be found. May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:13:27.229273 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e0298bd-7166-4b67-acf1-794621e95cdf could not be found. May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0298bd-7166-4b67-acf1-794621e95cdf could not be found. May 16 19:13:27.230479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:27.232871 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3861f046-68ad-470f-b340-bc3a2f002f53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Returning 404 to user: Instance 1e0298bd-7166-4b67-acf1-794621e95cdf could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:13:27.234999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-3861f046-68ad-470f-b340-bc3a2f002f53 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf" status: 404 len: 111 microversion: 2.1 time: 0.041152 May 16 19:13:27.239371 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 402/826] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:27 2022] GET /compute/v2.1/servers/1e0298bd-7166-4b67-acf1-794621e95cdf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:13:27.244462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-12bc5a44-26f5-4d42-8ef2-15dbfb960111 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] Calling method '.version_select at 0x7f1e1d8a74c0>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:27.271524 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-12bc5a44-26f5-4d42-8ef2-15dbfb960111 tempest-TestMinimumBasicScenario-60298331 tempest-TestMinimumBasicScenario-60298331-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-199862353" status: 202 len: 0 microversion: 2.1 time: 0.028829 May 16 19:13:27.273081 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 425/827] 10.222.0.24 () {58 vars in 1268 bytes} [Mon May 16 19:13:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-199862353 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 19:13:27.538747 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-32089036-b847-4933-ad38-07ee106fb58c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:27.539372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-32089036-b847-4933-ad38-07ee106fb58c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:27.545738 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-32089036-b847-4933-ad38-07ee106fb58c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:27.546543 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-32089036-b847-4933-ad38-07ee106fb58c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:27.547681 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-32089036-b847-4933-ad38-07ee106fb58c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:27.548446 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-32089036-b847-4933-ad38-07ee106fb58c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:27.721565 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-32089036-b847-4933-ad38-07ee106fb58c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:27.736269 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-32089036-b847-4933-ad38-07ee106fb58c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1288 microversion: 2.1 time: 0.201653 May 16 19:13:27.747476 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 403/828] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:27 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1288 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:28.755091 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-711e44e2-5e51-4dc6-b479-09277e9f695c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:28.755789 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-711e44e2-5e51-4dc6-b479-09277e9f695c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:28.768795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-711e44e2-5e51-4dc6-b479-09277e9f695c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:28.769445 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-711e44e2-5e51-4dc6-b479-09277e9f695c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:28.770868 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-711e44e2-5e51-4dc6-b479-09277e9f695c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:28.771308 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-711e44e2-5e51-4dc6-b479-09277e9f695c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:28.874051 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-711e44e2-5e51-4dc6-b479-09277e9f695c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:28.882848 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-711e44e2-5e51-4dc6-b479-09277e9f695c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1294 microversion: 2.1 time: 0.132377 May 16 19:13:28.883634 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 426/829] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:28 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1294 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:29.649923 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-5f5e65b6-bf09-4b3e-8774-7ad2dfa1fef5 req-949ee726-a037-4f60-b31d-7a9044b64aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb4d6c5-966a-44b0-a092-602b55ec665c", "tag": "2f53d2f3-16ec-408d-b308-a79d7b29c2e9"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:29.687337 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-5f5e65b6-bf09-4b3e-8774-7ad2dfa1fef5 req-949ee726-a037-4f60-b31d-7a9044b64aa0 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:29.688446 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-5f5e65b6-bf09-4b3e-8774-7ad2dfa1fef5 req-949ee726-a037-4f60-b31d-7a9044b64aa0 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:29.733573 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-5f5e65b6-bf09-4b3e-8774-7ad2dfa1fef5 req-949ee726-a037-4f60-b31d-7a9044b64aa0 service nova] Creating event network-changed:2f53d2f3-16ec-408d-b308-a79d7b29c2e9 for instance eeb4d6c5-966a-44b0-a092-602b55ec665c on hv-cinder-76606 May 16 19:13:29.759431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-5f5e65b6-bf09-4b3e-8774-7ad2dfa1fef5 req-949ee726-a037-4f60-b31d-7a9044b64aa0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126458 May 16 19:13:29.762510 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 404/830] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:29.901678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8e6786fd-5e3a-4366-a282-3a4aee604434 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:29.903692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8e6786fd-5e3a-4366-a282-3a4aee604434 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:29.916074 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8e6786fd-5e3a-4366-a282-3a4aee604434 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:29.919029 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8e6786fd-5e3a-4366-a282-3a4aee604434 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:29.920223 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8e6786fd-5e3a-4366-a282-3a4aee604434 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:29.921710 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8e6786fd-5e3a-4366-a282-3a4aee604434 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:30.516185 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-8e6786fd-5e3a-4366-a282-3a4aee604434 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:30.526665 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8e6786fd-5e3a-4366-a282-3a4aee604434 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1362 microversion: 2.1 time: 0.629601 May 16 19:13:30.527652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 427/831] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:29 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1362 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:31.553284 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3ca3eab1-da1d-4906-8f71-6a24cf984676 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:31.554222 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-3ca3eab1-da1d-4906-8f71-6a24cf984676 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:31.574373 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3ca3eab1-da1d-4906-8f71-6a24cf984676 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:31.574836 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3ca3eab1-da1d-4906-8f71-6a24cf984676 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:31.580818 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3ca3eab1-da1d-4906-8f71-6a24cf984676 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:31.583426 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3ca3eab1-da1d-4906-8f71-6a24cf984676 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:31.842343 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-6ecf397a-9ffa-46e7-86f5-4ed269fc688d req-552e0fa7-a772-4596-abfd-1179b1156813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb4d6c5-966a-44b0-a092-602b55ec665c", "tag": "2f53d2f3-16ec-408d-b308-a79d7b29c2e9"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:31.860281 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-6ecf397a-9ffa-46e7-86f5-4ed269fc688d req-552e0fa7-a772-4596-abfd-1179b1156813 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:31.861065 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-6ecf397a-9ffa-46e7-86f5-4ed269fc688d req-552e0fa7-a772-4596-abfd-1179b1156813 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:32.047627 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-3ca3eab1-da1d-4906-8f71-6a24cf984676 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:32.068491 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-3ca3eab1-da1d-4906-8f71-6a24cf984676 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1362 microversion: 2.1 time: 0.521309 May 16 19:13:32.070136 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 405/832] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:31 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1362 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:32.241217 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-6ecf397a-9ffa-46e7-86f5-4ed269fc688d req-552e0fa7-a772-4596-abfd-1179b1156813 service nova] Creating event network-changed:2f53d2f3-16ec-408d-b308-a79d7b29c2e9 for instance eeb4d6c5-966a-44b0-a092-602b55ec665c on hv-cinder-76606 May 16 19:13:32.258222 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-6ecf397a-9ffa-46e7-86f5-4ed269fc688d req-552e0fa7-a772-4596-abfd-1179b1156813 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.421452 May 16 19:13:32.259149 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 428/833] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:33.087415 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-479bff60-73eb-4ee8-8926-4fe1f9c55dc0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:33.088787 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-479bff60-73eb-4ee8-8926-4fe1f9c55dc0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:33.099875 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-479bff60-73eb-4ee8-8926-4fe1f9c55dc0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:33.100875 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-479bff60-73eb-4ee8-8926-4fe1f9c55dc0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:33.101921 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-479bff60-73eb-4ee8-8926-4fe1f9c55dc0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:33.102566 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-479bff60-73eb-4ee8-8926-4fe1f9c55dc0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:33.504309 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-479bff60-73eb-4ee8-8926-4fe1f9c55dc0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:33.512883 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-479bff60-73eb-4ee8-8926-4fe1f9c55dc0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1362 microversion: 2.1 time: 0.430938 May 16 19:13:33.525666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 406/834] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:33 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1362 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:34.309780 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-05986c8e-443d-41fa-bf0c-bcef78f477dd req-12208649-35a3-4951-94f7-912c457840d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec122f45-8f35-47df-85df-f54da6781402", "tag": "682e565b-db4b-4d5d-847e-10679093da8c"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:34.324501 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-05986c8e-443d-41fa-bf0c-bcef78f477dd req-12208649-35a3-4951-94f7-912c457840d2 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:34.325229 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-05986c8e-443d-41fa-bf0c-bcef78f477dd req-12208649-35a3-4951-94f7-912c457840d2 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:34.339285 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-05986c8e-443d-41fa-bf0c-bcef78f477dd req-12208649-35a3-4951-94f7-912c457840d2 service nova] Creating event network-changed:682e565b-db4b-4d5d-847e-10679093da8c for instance ec122f45-8f35-47df-85df-f54da6781402 on hv-cinder-76606 May 16 19:13:34.345929 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-05986c8e-443d-41fa-bf0c-bcef78f477dd req-12208649-35a3-4951-94f7-912c457840d2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043895 May 16 19:13:34.347163 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 429/835] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:13:34.536037 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8abaeaf9-a7d0-45ad-ae1e-df918119a66f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:34.538029 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8abaeaf9-a7d0-45ad-ae1e-df918119a66f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:34.562659 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8abaeaf9-a7d0-45ad-ae1e-df918119a66f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:34.563369 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8abaeaf9-a7d0-45ad-ae1e-df918119a66f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:34.565276 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8abaeaf9-a7d0-45ad-ae1e-df918119a66f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:34.566138 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8abaeaf9-a7d0-45ad-ae1e-df918119a66f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:35.181602 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8abaeaf9-a7d0-45ad-ae1e-df918119a66f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:35.189195 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8abaeaf9-a7d0-45ad-ae1e-df918119a66f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1362 microversion: 2.1 time: 0.660089 May 16 19:13:35.190129 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 407/836] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:34 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1362 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:36.208373 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2c9ecfee-20a5-45ec-8477-6f5513b16a0c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:36.209782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2c9ecfee-20a5-45ec-8477-6f5513b16a0c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:36.220670 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c9ecfee-20a5-45ec-8477-6f5513b16a0c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:36.222435 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c9ecfee-20a5-45ec-8477-6f5513b16a0c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:36.223394 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c9ecfee-20a5-45ec-8477-6f5513b16a0c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:36.223991 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c9ecfee-20a5-45ec-8477-6f5513b16a0c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:36.523896 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2c9ecfee-20a5-45ec-8477-6f5513b16a0c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:36.546329 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2c9ecfee-20a5-45ec-8477-6f5513b16a0c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1362 microversion: 2.1 time: 0.336084 May 16 19:13:36.559302 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 430/837] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:36 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:37.563515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8bf7c0df-f906-443f-95db-f629af319d47 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:37.564777 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8bf7c0df-f906-443f-95db-f629af319d47 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:37.579741 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8bf7c0df-f906-443f-95db-f629af319d47 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:37.583790 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8bf7c0df-f906-443f-95db-f629af319d47 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:37.584914 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8bf7c0df-f906-443f-95db-f629af319d47 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:37.585352 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8bf7c0df-f906-443f-95db-f629af319d47 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:37.647905 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-a24caf26-b958-40c0-b179-d6da6eb0f43a req-d34acfb6-8cab-4f35-9b37-2e86ee96a0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec122f45-8f35-47df-85df-f54da6781402", "name": "network-vif-plugged", "status": "completed", "tag": "682e565b-db4b-4d5d-847e-10679093da8c"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:37.670588 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-a24caf26-b958-40c0-b179-d6da6eb0f43a req-d34acfb6-8cab-4f35-9b37-2e86ee96a0a8 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:37.671298 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-a24caf26-b958-40c0-b179-d6da6eb0f43a req-d34acfb6-8cab-4f35-9b37-2e86ee96a0a8 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:37.703214 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-a24caf26-b958-40c0-b179-d6da6eb0f43a req-d34acfb6-8cab-4f35-9b37-2e86ee96a0a8 service nova] Creating event network-vif-plugged:682e565b-db4b-4d5d-847e-10679093da8c for instance ec122f45-8f35-47df-85df-f54da6781402 on hv-cinder-76606 May 16 19:13:37.718622 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-a24caf26-b958-40c0-b179-d6da6eb0f43a req-d34acfb6-8cab-4f35-9b37-2e86ee96a0a8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077294 May 16 19:13:37.722611 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 431/838] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:37.905472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8bf7c0df-f906-443f-95db-f629af319d47 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:37.922799 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8bf7c0df-f906-443f-95db-f629af319d47 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1362 microversion: 2.1 time: 0.363542 May 16 19:13:37.923954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 408/839] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:37 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:38.939866 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-41386a6a-488f-4074-91a4-113ba9b6d0d3 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:38.940585 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-41386a6a-488f-4074-91a4-113ba9b6d0d3 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:38.948096 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-41386a6a-488f-4074-91a4-113ba9b6d0d3 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:38.948539 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-41386a6a-488f-4074-91a4-113ba9b6d0d3 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:38.949614 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-41386a6a-488f-4074-91a4-113ba9b6d0d3 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:38.949960 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-41386a6a-488f-4074-91a4-113ba9b6d0d3 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:39.187133 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-41386a6a-488f-4074-91a4-113ba9b6d0d3 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:39.194930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-41386a6a-488f-4074-91a4-113ba9b6d0d3 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1362 microversion: 2.1 time: 0.259336 May 16 19:13:39.197769 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 432/840] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:38 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:40.213488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-80c88e37-cf7e-4de6-931f-9f39f133efd4 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:40.214892 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-80c88e37-cf7e-4de6-931f-9f39f133efd4 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:40.227944 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-80c88e37-cf7e-4de6-931f-9f39f133efd4 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:40.228631 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-80c88e37-cf7e-4de6-931f-9f39f133efd4 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:40.229819 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-80c88e37-cf7e-4de6-931f-9f39f133efd4 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:40.230256 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-80c88e37-cf7e-4de6-931f-9f39f133efd4 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:40.396207 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-80c88e37-cf7e-4de6-931f-9f39f133efd4 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:40.404614 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-80c88e37-cf7e-4de6-931f-9f39f133efd4 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1547 microversion: 2.1 time: 0.195847 May 16 19:13:40.405198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 409/841] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:40 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1547 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:40.422455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-42a7dc4b-5ce9-48d2-af3e-92a3bca1779f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:40.423633 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-42a7dc4b-5ce9-48d2-af3e-92a3bca1779f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:40.437246 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-42a7dc4b-5ce9-48d2-af3e-92a3bca1779f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:40.437998 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-42a7dc4b-5ce9-48d2-af3e-92a3bca1779f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:40.439004 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-42a7dc4b-5ce9-48d2-af3e-92a3bca1779f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:40.439445 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-42a7dc4b-5ce9-48d2-af3e-92a3bca1779f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:40.607343 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-42a7dc4b-5ce9-48d2-af3e-92a3bca1779f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188192 May 16 19:13:40.609882 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 433/842] 10.222.0.24 () {58 vars in 1274 bytes} [Mon May 16 19:13:40 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:41.833169 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b5d8dc1f-06cb-4d09-a6fc-baf68d322a71 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Action: 'create', calling method: .version_select at 0x7f1e0bd17ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1176123874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL09nXARTqXWjvJlTgse8fyPLR+hCxOgpqOylDUURkjbNrvbIeCjyaWfQqNR/INbB2Q9PEDDtrePycQSFaxXvbF6WYYDXo/VTy44Zmgfz3acHJ85FifC1oZPNo3yl4aPAA=="}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:41.857141 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-b5d8dc1f-06cb-4d09-a6fc-baf68d322a71 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Getting quotas for project 385ae3c7ea8347d7bfc346d8bc7fda4a. Resources: {'key_pairs'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:13:41.864119 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-b5d8dc1f-06cb-4d09-a6fc-baf68d322a71 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Getting quotas for user 64634c902a884b84a8bd2d3c10ce6270 and project 385ae3c7ea8347d7bfc346d8bc7fda4a. Resources: {'key_pairs'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:13:41.896801 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-948dbe25-84a9-4d1a-b2ea-86754d74dcf2 req-b6be856c-a2b4-43c3-b0d9-abf89d6ee61b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec122f45-8f35-47df-85df-f54da6781402", "tag": "682e565b-db4b-4d5d-847e-10679093da8c"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:41.911957 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-948dbe25-84a9-4d1a-b2ea-86754d74dcf2 req-b6be856c-a2b4-43c3-b0d9-abf89d6ee61b service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:41.913705 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-948dbe25-84a9-4d1a-b2ea-86754d74dcf2 req-b6be856c-a2b4-43c3-b0d9-abf89d6ee61b service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:41.927040 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b5d8dc1f-06cb-4d09-a6fc-baf68d322a71 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.386901 May 16 19:13:41.927666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 410/843] 10.222.0.24 () {60 vars in 1158 bytes} [Mon May 16 19:13:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:41.947221 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-948dbe25-84a9-4d1a-b2ea-86754d74dcf2 req-b6be856c-a2b4-43c3-b0d9-abf89d6ee61b service nova] Creating event network-changed:682e565b-db4b-4d5d-847e-10679093da8c for instance ec122f45-8f35-47df-85df-f54da6781402 on hv-cinder-76606 May 16 19:13:41.957407 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-948dbe25-84a9-4d1a-b2ea-86754d74dcf2 req-b6be856c-a2b4-43c3-b0d9-abf89d6ee61b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166981 May 16 19:13:41.958547 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 434/844] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:13:44.720880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c903d760-0090-4440-be3c-c4d63f1cdfe6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:44.721489 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c903d760-0090-4440-be3c-c4d63f1cdfe6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:44.729590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c903d760-0090-4440-be3c-c4d63f1cdfe6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:44.730170 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c903d760-0090-4440-be3c-c4d63f1cdfe6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:44.731252 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c903d760-0090-4440-be3c-c4d63f1cdfe6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:44.731697 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c903d760-0090-4440-be3c-c4d63f1cdfe6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:44.756582 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c903d760-0090-4440-be3c-c4d63f1cdfe6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8/ips" status: 200 len: 149 microversion: 2.1 time: 0.151816 May 16 19:13:44.757128 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 411/845] 10.222.0.24 () {58 vars in 1247 bytes} [Mon May 16 19:13:44 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8/ips => generated 149 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:13:46.107502 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-592dc0ee-37bd-4844-9bdd-2d77e189f5ff tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3dc0e60-387b-47e5-b332-447f7e2191d3"}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:46.108665 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-592dc0ee-37bd-4844-9bdd-2d77e189f5ff tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:46.121005 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-592dc0ee-37bd-4844-9bdd-2d77e189f5ff tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:46.121426 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-592dc0ee-37bd-4844-9bdd-2d77e189f5ff tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:46.122290 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-592dc0ee-37bd-4844-9bdd-2d77e189f5ff tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:46.122724 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-592dc0ee-37bd-4844-9bdd-2d77e189f5ff tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:46.384692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-592dc0ee-37bd-4844-9bdd-2d77e189f5ff tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "POST /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280832 May 16 19:13:46.385322 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 435/846] 10.222.0.24 () {60 vars in 1322 bytes} [Mon May 16 19:13:46 2022] POST /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:53.921452 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-75ec831f-2c47-4025-956f-ebca8aed26d9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3dc0e60-387b-47e5-b332-447f7e2191d3"}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:53.922555 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-75ec831f-2c47-4025-956f-ebca8aed26d9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:53.928838 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-75ec831f-2c47-4025-956f-ebca8aed26d9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:53.929279 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-75ec831f-2c47-4025-956f-ebca8aed26d9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:53.930161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-75ec831f-2c47-4025-956f-ebca8aed26d9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:53.930593 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-75ec831f-2c47-4025-956f-ebca8aed26d9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:54.014744 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-75ec831f-2c47-4025-956f-ebca8aed26d9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] HTTP exception thrown: Invalid volume: volume f3dc0e60-387b-47e5-b332-447f7e2191d3 is already attached to instances: 7436d70f-ee98-42cc-95ff-4aa094d149c8 May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-75ec831f-2c47-4025-956f-ebca8aed26d9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Request method failure captured: May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: POST /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8/os-volume_attachments HTTP/1.1 May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 74 May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqEkfBgf-5XfH-1I-yuCRcEsCpbyBI1UoIvKz5FJMT4bGAMlNwLp0yu1A3yPkFIrpPBwb538SaogfPDVB6aYcwOKGjLO5ozfcqhZhnWzIyH6lLDvijCwB-q9kEmQJZsKm_pVPahD7yWMKKOQtIBayABLCJCDJpGvPEjaCIlQWvmenMs May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:13:54.017809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:13:54.019500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:13:54.019500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:13:54.019500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:13:54.019500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:13:54.019500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:13:54.019500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:13:54.019500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:13:54.019500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 7d3af11e1ffc4ab1a37669f893d2f3be May 16 19:13:54.019500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:13:54.019500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: May 16 19:13:54.019500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {"volumeAttachment": {"volumeId": "f3dc0e60-387b-47e5-b332-447f7e2191d3"}} May 16 19:13:54.019500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Invalid volume: volume f3dc0e60-387b-47e5-b332-447f7e2191d3 is already attached to instances: 7436d70f-ee98-42cc-95ff-4aa094d149c8 May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'server_id': '7436d70f-ee98-42cc-95ff-4aa094d149c8', 'body': {'volumeAttachment': {'volumeId': 'f3dc0e60-387b-47e5-b332-447f7e2191d3'}}} May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f3dc0e60-387b-47e5-b332-447f7e2191d3 is already attached to instances: 7436d70f-ee98-42cc-95ff-4aa094d149c8 May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:54.020661 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f3dc0e60-387b-47e5-b332-447f7e2191d3 is already attached to instances: 7436d70f-ee98-42cc-95ff-4aa094d149c8 May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:54.021996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:13:54.023622 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:13:54.023622 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:13:54.023622 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:13:54.023622 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f3dc0e60-387b-47e5-b332-447f7e2191d3 is already attached to instances: 7436d70f-ee98-42cc-95ff-4aa094d149c8 May 16 19:13:54.023622 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:13:54.023622 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-75ec831f-2c47-4025-956f-ebca8aed26d9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Returning 400 to user: Invalid volume: volume f3dc0e60-387b-47e5-b332-447f7e2191d3 is already attached to instances: 7436d70f-ee98-42cc-95ff-4aa094d149c8 {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:13:54.023622 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-75ec831f-2c47-4025-956f-ebca8aed26d9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "POST /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102221 May 16 19:13:54.023622 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 412/847] 10.222.0.24 () {60 vars in 1322 bytes} [Mon May 16 19:13:53 2022] POST /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 19:13:54.083289 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-628ef3e2-40c5-4ac7-acda-46734ec906c4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:54.083864 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-628ef3e2-40c5-4ac7-acda-46734ec906c4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:54.090851 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-628ef3e2-40c5-4ac7-acda-46734ec906c4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:54.091296 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-628ef3e2-40c5-4ac7-acda-46734ec906c4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:54.092057 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-628ef3e2-40c5-4ac7-acda-46734ec906c4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:54.092481 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-628ef3e2-40c5-4ac7-acda-46734ec906c4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:54.177319 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-628ef3e2-40c5-4ac7-acda-46734ec906c4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lazy-loading 'services' on Instance uuid 7436d70f-ee98-42cc-95ff-4aa094d149c8 {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:13:54.250997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-628ef3e2-40c5-4ac7-acda-46734ec906c4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8/os-volume_attachments/f3dc0e60-387b-47e5-b332-447f7e2191d3" status: 202 len: 0 microversion: 2.1 time: 0.171882 May 16 19:13:54.251557 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 436/848] 10.222.0.24 () {58 vars in 1415 bytes} [Mon May 16 19:13:54 2022] DELETE /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8/os-volume_attachments/f3dc0e60-387b-47e5-b332-447f7e2191d3 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:13:54.260267 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-80a4fe8d-48a9-4993-80de-0d27e05682f4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:54.261287 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-80a4fe8d-48a9-4993-80de-0d27e05682f4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:54.268947 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-80a4fe8d-48a9-4993-80de-0d27e05682f4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:54.269432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-80a4fe8d-48a9-4993-80de-0d27e05682f4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:54.270712 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-80a4fe8d-48a9-4993-80de-0d27e05682f4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:54.271146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-80a4fe8d-48a9-4993-80de-0d27e05682f4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:54.303711 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-80a4fe8d-48a9-4993-80de-0d27e05682f4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047570 May 16 19:13:54.304311 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 413/849] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:13:54 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:13:55.316709 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c79f21e3-2614-4626-9e66-0b8ceead384c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:55.317784 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c79f21e3-2614-4626-9e66-0b8ceead384c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:55.324826 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c79f21e3-2614-4626-9e66-0b8ceead384c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:55.325295 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c79f21e3-2614-4626-9e66-0b8ceead384c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:55.326186 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c79f21e3-2614-4626-9e66-0b8ceead384c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:55.326617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c79f21e3-2614-4626-9e66-0b8ceead384c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:55.359500 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c79f21e3-2614-4626-9e66-0b8ceead384c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047787 May 16 19:13:55.360061 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 437/850] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:13:55 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 19:13:55.417055 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f8984794-ef19-47d1-ad31-155b9e31662e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:55.417757 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f8984794-ef19-47d1-ad31-155b9e31662e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:55.424493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f8984794-ef19-47d1-ad31-155b9e31662e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:55.424941 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f8984794-ef19-47d1-ad31-155b9e31662e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:55.425757 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f8984794-ef19-47d1-ad31-155b9e31662e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:55.426190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f8984794-ef19-47d1-ad31-155b9e31662e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:55.451104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f8984794-ef19-47d1-ad31-155b9e31662e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Going to try to terminate instance {{(pid=117275) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:13:55.530497 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f8984794-ef19-47d1-ad31-155b9e31662e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 204 len: 0 microversion: 2.1 time: 0.117027 May 16 19:13:55.531634 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 414/851] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:13:55 2022] DELETE /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 19:13:55.540294 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e6abf238-56ee-4026-bc95-a4ec2ee22b6c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:55.540907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e6abf238-56ee-4026-bc95-a4ec2ee22b6c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:55.546933 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e6abf238-56ee-4026-bc95-a4ec2ee22b6c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:55.547385 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e6abf238-56ee-4026-bc95-a4ec2ee22b6c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:55.548147 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e6abf238-56ee-4026-bc95-a4ec2ee22b6c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:55.548580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e6abf238-56ee-4026-bc95-a4ec2ee22b6c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:55.685169 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e6abf238-56ee-4026-bc95-a4ec2ee22b6c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:55.697064 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e6abf238-56ee-4026-bc95-a4ec2ee22b6c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1681 microversion: 2.1 time: 0.160371 May 16 19:13:55.697885 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 438/852] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:55 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:13:56.725424 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-aa972e4b-89cc-4401-ac4c-5c0f96e2b0f3 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:56.726666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-aa972e4b-89cc-4401-ac4c-5c0f96e2b0f3 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:56.734415 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-aa972e4b-89cc-4401-ac4c-5c0f96e2b0f3 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:56.734868 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-aa972e4b-89cc-4401-ac4c-5c0f96e2b0f3 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:56.735641 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-aa972e4b-89cc-4401-ac4c-5c0f96e2b0f3 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:56.736072 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-aa972e4b-89cc-4401-ac4c-5c0f96e2b0f3 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:57.132324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-aa972e4b-89cc-4401-ac4c-5c0f96e2b0f3 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:57.143641 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-aa972e4b-89cc-4401-ac4c-5c0f96e2b0f3 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1681 microversion: 2.1 time: 0.425320 May 16 19:13:57.144812 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 415/853] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:56 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1681 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:58.163555 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7a0feeb5-1376-4f9a-afbc-b5495b8138d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:58.164141 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7a0feeb5-1376-4f9a-afbc-b5495b8138d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:58.171248 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7a0feeb5-1376-4f9a-afbc-b5495b8138d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:58.171715 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7a0feeb5-1376-4f9a-afbc-b5495b8138d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:58.172493 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7a0feeb5-1376-4f9a-afbc-b5495b8138d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:58.172925 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7a0feeb5-1376-4f9a-afbc-b5495b8138d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:58.235648 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7a0feeb5-1376-4f9a-afbc-b5495b8138d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:13:58.243897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7a0feeb5-1376-4f9a-afbc-b5495b8138d4 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 200 len: 1614 microversion: 2.1 time: 0.084227 May 16 19:13:58.244563 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 439/854] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:58 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 1614 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:13:58.503560 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-685662bf-d324-4b01-b292-7f6d58c58265 req-5a21711d-2c44-4a52-a43c-f143e16a3ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7436d70f-ee98-42cc-95ff-4aa094d149c8", "name": "network-vif-deleted", "tag": "34e977f1-14f8-42d4-a048-80b967122723"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:58.514034 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-685662bf-d324-4b01-b292-7f6d58c58265 req-5a21711d-2c44-4a52-a43c-f143e16a3ae4 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:58.514719 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-685662bf-d324-4b01-b292-7f6d58c58265 req-5a21711d-2c44-4a52-a43c-f143e16a3ae4 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:58.528610 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-685662bf-d324-4b01-b292-7f6d58c58265 req-5a21711d-2c44-4a52-a43c-f143e16a3ae4 service nova] Creating event network-vif-deleted:34e977f1-14f8-42d4-a048-80b967122723 for instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 on hv-cinder-76606 May 16 19:13:58.535453 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-685662bf-d324-4b01-b292-7f6d58c58265 req-5a21711d-2c44-4a52-a43c-f143e16a3ae4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035188 May 16 19:13:58.536959 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 416/855] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:13:59.261770 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4ec2f100-c3f6-4d5b-aecb-7592c30df9ac tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:59.262374 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-4ec2f100-c3f6-4d5b-aecb-7592c30df9ac tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:13:59.269736 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4ec2f100-c3f6-4d5b-aecb-7592c30df9ac tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:59.270190 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4ec2f100-c3f6-4d5b-aecb-7592c30df9ac tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:59.270938 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4ec2f100-c3f6-4d5b-aecb-7592c30df9ac tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:13:59.271373 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4ec2f100-c3f6-4d5b-aecb-7592c30df9ac tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:13:59.285997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-4ec2f100-c3f6-4d5b-aecb-7592c30df9ac tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] HTTP exception thrown: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4ec2f100-c3f6-4d5b-aecb-7592c30df9ac tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Request method failure captured: May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 HTTP/1.1 May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqEkfBgf-5XfH-1I-yuCRcEsCpbyBI1UoIvKz5FJMT4bGAMlNwLp0yu1A3yPkFIrpPBwb538SaogfPDVB6aYcwOKGjLO5ozfcqhZhnWzIyH6lLDvijCwB-q9kEmQJZsKm_pVPahD7yWMKKOQtIBayABLCJCDJpGvPEjaCIlQWvmenMs May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:13:59.287714 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:13:59.289377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:13:59.289377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:13:59.289377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:13:59.289377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:13:59.289377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:13:59.289377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:13:59.289377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:13:59.289377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 7d3af11e1ffc4ab1a37669f893d2f3be May 16 19:13:59.289377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:13:59.289377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:13:59.289377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. May 16 19:13:59.289377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': '7436d70f-ee98-42cc-95ff-4aa094d149c8'} May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:13:59.291144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. May 16 19:13:59.292627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:13:59.293938 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4ec2f100-c3f6-4d5b-aecb-7592c30df9ac tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Returning 404 to user: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:13:59.293938 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4ec2f100-c3f6-4d5b-aecb-7592c30df9ac tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 404 len: 111 microversion: 2.1 time: 0.031405 May 16 19:13:59.293938 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 440/856] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:13:59 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:13:59.298989 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e4e93325-c683-420f-88aa-9366a6a724e2 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '.version_select at 0x7f1e0be32dc0>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:13:59.318996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e4e93325-c683-420f-88aa-9366a6a724e2 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600270445" status: 202 len: 0 microversion: 2.1 time: 0.024230 May 16 19:13:59.319587 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 417/857] 10.222.0.24 () {58 vars in 1220 bytes} [Mon May 16 19:13:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600270445 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:13:59.939116 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e361c074-9add-4988-88df-433b17ffd436 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Action: 'create', calling method: .version_select at 0x7f1e184cdc10>, body: {"keypair": {"name": "tempest-keypair-614031191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7AfjN6vnKy8PpGVQQhMsxs7DxwRoi97AXWAZ6SRDDG0dNWp/AetQHLaJVjuZ8VkfWuU2I2/MWOqjYY6PadCTLbzkdcDwXuaPeCf8EK7psma1rnRurQfBV9a8cE7Nw7rQ=="}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:13:59.954346 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-e361c074-9add-4988-88df-433b17ffd436 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Getting quotas for project dd195af6f92c42a18ed7051eae26dbaa. Resources: {'key_pairs'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:13:59.958449 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-e361c074-9add-4988-88df-433b17ffd436 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Getting quotas for user 7d3af11e1ffc4ab1a37669f893d2f3be and project dd195af6f92c42a18ed7051eae26dbaa. Resources: {'key_pairs'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:13:59.982763 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e361c074-9add-4988-88df-433b17ffd436 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047589 May 16 19:13:59.983361 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 441/858] 10.222.0.24 () {60 vars in 1158 bytes} [Mon May 16 19:13:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:00.511590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-2d43da03-e7e4-4c67-9331-1db85193c298 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-475509714", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1176123874", "security_groups": [{"name": "tempest-secgroup-smoke-33929672"}], "block_device_mapping_v2": [{"uuid": "4a364c5f-d6c8-49a3-8898-37611f119507", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "76a0db38-1a09-4cf8-86ec-0bf0b9de76ec"}]}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:00.627129 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.network.neutron [None req-2d43da03-e7e4-4c67-9331-1db85193c298 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] validate_networks() for [('76a0db38-1a09-4cf8-86ec-0bf0b9de76ec', None, None, None, None, None)] {{(pid=117275) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:14:01.095051 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-2d43da03-e7e4-4c67-9331-1db85193c298 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Flavor limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:14:01.095498 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-2d43da03-e7e4-4c67-9331-1db85193c298 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Image limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:14:01.095966 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-2d43da03-e7e4-4c67-9331-1db85193c298 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Flavor pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:14:01.096454 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-2d43da03-e7e4-4c67-9331-1db85193c298 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Image pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:14:01.096880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-2d43da03-e7e4-4c67-9331-1db85193c298 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:14:01.105714 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2d43da03-e7e4-4c67-9331-1db85193c298 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:01.106161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2d43da03-e7e4-4c67-9331-1db85193c298 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:01.106982 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2d43da03-e7e4-4c67-9331-1db85193c298 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:01.107414 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2d43da03-e7e4-4c67-9331-1db85193c298 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:01.124995 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-2d43da03-e7e4-4c67-9331-1db85193c298 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Getting quotas for project 385ae3c7ea8347d7bfc346d8bc7fda4a. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:14:01.129038 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-2d43da03-e7e4-4c67-9331-1db85193c298 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Getting quotas for user 64634c902a884b84a8bd2d3c10ce6270 and project 385ae3c7ea8347d7bfc346d8bc7fda4a. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:14:01.187710 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-2d43da03-e7e4-4c67-9331-1db85193c298 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Going to run 1 instances... {{(pid=117275) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:14:01.189971 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-2d43da03-e7e4-4c67-9331-1db85193c298 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a364c5f-d6c8-49a3-8898-37611f119507',volume_size=None,volume_type=None)] {{(pid=117275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:14:01.268411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e2a61ca4-87d2-4c84-a4b0-5edfda014fda tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1162416870", "imageRef": "d1bd841c-7ec7-4e1e-9d86-ce94f9400d38", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9cbd7ed-b011-47eb-8de6-48451d865294"}], "security_groups": [{"name": "tempest-securitygroup--1074872901"}], "key_name": "tempest-keypair-614031191", "user_data": "}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:01.325514 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-2d43da03-e7e4-4c67-9331-1db85193c298 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.818033 May 16 19:14:01.326427 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 418/859] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:14:00 2022] POST /compute/v2.1/servers => generated 404 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:14:01.336815 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-15d74c90-3f64-49dd-a7a8-e133beb4bc57 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:01.337436 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-15d74c90-3f64-49dd-a7a8-e133beb4bc57 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:01.375813 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.network.neutron [None req-e2a61ca4-87d2-4c84-a4b0-5edfda014fda tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] validate_networks() for [('b9cbd7ed-b011-47eb-8de6-48451d865294', None, None, None, None, None)] {{(pid=117274) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:14:01.395619 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-15d74c90-3f64-49dd-a7a8-e133beb4bc57 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:01.403176 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-15d74c90-3f64-49dd-a7a8-e133beb4bc57 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1094 microversion: 2.1 time: 0.070765 May 16 19:14:01.403834 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 419/860] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:01 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:01.795045 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-e2a61ca4-87d2-4c84-a4b0-5edfda014fda tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Flavor limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:14:01.795501 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-e2a61ca4-87d2-4c84-a4b0-5edfda014fda tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Image limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:14:01.795989 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-e2a61ca4-87d2-4c84-a4b0-5edfda014fda tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Flavor pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:14:01.796578 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-e2a61ca4-87d2-4c84-a4b0-5edfda014fda tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Image pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:14:01.796999 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-e2a61ca4-87d2-4c84-a4b0-5edfda014fda tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:14:01.805909 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e2a61ca4-87d2-4c84-a4b0-5edfda014fda tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:01.806355 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e2a61ca4-87d2-4c84-a4b0-5edfda014fda tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:01.807151 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e2a61ca4-87d2-4c84-a4b0-5edfda014fda tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:01.807589 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e2a61ca4-87d2-4c84-a4b0-5edfda014fda tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:01.824176 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-e2a61ca4-87d2-4c84-a4b0-5edfda014fda tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Getting quotas for project dd195af6f92c42a18ed7051eae26dbaa. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:14:01.828243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-e2a61ca4-87d2-4c84-a4b0-5edfda014fda tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Getting quotas for user 7d3af11e1ffc4ab1a37669f893d2f3be and project dd195af6f92c42a18ed7051eae26dbaa. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:14:01.839535 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e2a61ca4-87d2-4c84-a4b0-5edfda014fda tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Going to run 1 instances... {{(pid=117274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:14:01.841844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e2a61ca4-87d2-4c84-a4b0-5edfda014fda tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bd841c-7ec7-4e1e-9d86-ce94f9400d38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:14:01.887070 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e2a61ca4-87d2-4c84-a4b0-5edfda014fda tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.626348 May 16 19:14:01.887919 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 442/861] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:14:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 19:14:01.899604 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b9dc5ef9-aec6-4628-86f9-c511cc95df73 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:01.901101 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b9dc5ef9-aec6-4628-86f9-c511cc95df73 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:01.967964 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b9dc5ef9-aec6-4628-86f9-c511cc95df73 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:01.975221 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b9dc5ef9-aec6-4628-86f9-c511cc95df73 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1241 microversion: 2.1 time: 0.080901 May 16 19:14:01.976113 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 420/862] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:01 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:14:02.421721 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7fd6acdc-0626-44e8-ade9-34d03c1ae3ea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:02.423146 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7fd6acdc-0626-44e8-ade9-34d03c1ae3ea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:02.430052 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7fd6acdc-0626-44e8-ade9-34d03c1ae3ea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:02.430899 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7fd6acdc-0626-44e8-ade9-34d03c1ae3ea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:02.431891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7fd6acdc-0626-44e8-ade9-34d03c1ae3ea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:02.433086 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7fd6acdc-0626-44e8-ade9-34d03c1ae3ea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:02.501886 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7fd6acdc-0626-44e8-ade9-34d03c1ae3ea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:02.509425 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7fd6acdc-0626-44e8-ade9-34d03c1ae3ea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1210 microversion: 2.1 time: 0.092618 May 16 19:14:02.510053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 443/863] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:02 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:02.994262 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-57002e6d-c476-4740-94cf-5a4a53574108 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:02.995001 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-57002e6d-c476-4740-94cf-5a4a53574108 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:03.003339 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-57002e6d-c476-4740-94cf-5a4a53574108 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:03.004223 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-57002e6d-c476-4740-94cf-5a4a53574108 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:03.005576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-57002e6d-c476-4740-94cf-5a4a53574108 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:03.006255 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-57002e6d-c476-4740-94cf-5a4a53574108 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:03.112912 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-57002e6d-c476-4740-94cf-5a4a53574108 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:03.121668 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-57002e6d-c476-4740-94cf-5a4a53574108 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1311 microversion: 2.1 time: 0.132907 May 16 19:14:03.131163 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 421/864] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:02 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1311 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:03.528365 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9d44c4c9-1f2b-40db-b2c4-6f36b35204fd tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:03.529008 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9d44c4c9-1f2b-40db-b2c4-6f36b35204fd tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:03.535766 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9d44c4c9-1f2b-40db-b2c4-6f36b35204fd tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:03.536153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9d44c4c9-1f2b-40db-b2c4-6f36b35204fd tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:03.536936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9d44c4c9-1f2b-40db-b2c4-6f36b35204fd tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:03.537376 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9d44c4c9-1f2b-40db-b2c4-6f36b35204fd tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:03.677481 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9d44c4c9-1f2b-40db-b2c4-6f36b35204fd tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:03.685265 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9d44c4c9-1f2b-40db-b2c4-6f36b35204fd tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1264 microversion: 2.1 time: 0.161930 May 16 19:14:03.685991 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 444/865] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:03 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:04.141440 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d91730b5-1705-4a81-b5df-5fabf28248ae tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:04.142238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d91730b5-1705-4a81-b5df-5fabf28248ae tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:04.149795 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d91730b5-1705-4a81-b5df-5fabf28248ae tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:04.150243 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d91730b5-1705-4a81-b5df-5fabf28248ae tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:04.151060 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d91730b5-1705-4a81-b5df-5fabf28248ae tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:04.151491 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d91730b5-1705-4a81-b5df-5fabf28248ae tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:04.375307 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-20f3eb8b-f38f-48fd-852b-cb7706894064 req-092892ec-f7ad-48cd-8e7f-ce0282b406ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3e480e-c9ee-46ba-8393-c289b3fee9eb", "tag": "b4806342-52fb-4a7f-bc66-ac85ae8e8213"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:04.396155 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-20f3eb8b-f38f-48fd-852b-cb7706894064 req-092892ec-f7ad-48cd-8e7f-ce0282b406ca service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:04.396626 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-20f3eb8b-f38f-48fd-852b-cb7706894064 req-092892ec-f7ad-48cd-8e7f-ce0282b406ca service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:04.423685 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-20f3eb8b-f38f-48fd-852b-cb7706894064 req-092892ec-f7ad-48cd-8e7f-ce0282b406ca service nova] Creating event network-changed:b4806342-52fb-4a7f-bc66-ac85ae8e8213 for instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb on hv-cinder-76606 May 16 19:14:04.432006 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d91730b5-1705-4a81-b5df-5fabf28248ae tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:04.433346 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-20f3eb8b-f38f-48fd-852b-cb7706894064 req-092892ec-f7ad-48cd-8e7f-ce0282b406ca service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061617 May 16 19:14:04.434656 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 445/866] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:04.440863 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d91730b5-1705-4a81-b5df-5fabf28248ae tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1367 microversion: 2.1 time: 0.305308 May 16 19:14:04.441456 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 422/867] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:04 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:04.705140 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-6e854548-b519-4697-9d26-14e053a6cec9 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:04.705964 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-6e854548-b519-4697-9d26-14e053a6cec9 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:04.712980 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6e854548-b519-4697-9d26-14e053a6cec9 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:04.713429 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6e854548-b519-4697-9d26-14e053a6cec9 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:04.714241 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6e854548-b519-4697-9d26-14e053a6cec9 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:04.714674 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6e854548-b519-4697-9d26-14e053a6cec9 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:04.849824 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-6e854548-b519-4697-9d26-14e053a6cec9 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:04.857561 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-6e854548-b519-4697-9d26-14e053a6cec9 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1264 microversion: 2.1 time: 0.156720 May 16 19:14:04.858336 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 446/868] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:04 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:05.458463 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-bab1e91d-e747-4ebc-8fad-0466e196a52c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:05.459047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-bab1e91d-e747-4ebc-8fad-0466e196a52c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:05.465710 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bab1e91d-e747-4ebc-8fad-0466e196a52c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:05.466162 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bab1e91d-e747-4ebc-8fad-0466e196a52c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:05.466947 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bab1e91d-e747-4ebc-8fad-0466e196a52c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:05.467420 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bab1e91d-e747-4ebc-8fad-0466e196a52c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:05.700134 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-bab1e91d-e747-4ebc-8fad-0466e196a52c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:05.708706 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-bab1e91d-e747-4ebc-8fad-0466e196a52c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1367 microversion: 2.1 time: 0.254044 May 16 19:14:05.709701 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 423/869] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:05 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:05.874830 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-64e36635-3ccd-415a-addc-2b685d28fe76 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:05.875444 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-64e36635-3ccd-415a-addc-2b685d28fe76 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:05.882416 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-64e36635-3ccd-415a-addc-2b685d28fe76 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:05.882894 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-64e36635-3ccd-415a-addc-2b685d28fe76 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:05.883653 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-64e36635-3ccd-415a-addc-2b685d28fe76 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:05.884273 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-64e36635-3ccd-415a-addc-2b685d28fe76 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:06.031045 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-64e36635-3ccd-415a-addc-2b685d28fe76 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:06.039496 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-64e36635-3ccd-415a-addc-2b685d28fe76 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1264 microversion: 2.1 time: 0.168651 May 16 19:14:06.040350 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 447/870] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:05 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:06.452152 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-f6079c72-a8b2-4ede-afb2-0e8a43f211e6 req-9f26c9df-4a61-4715-bd29-bd5fb6c245b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0498aab-f458-4907-8557-c094918d4cdd", "tag": "ca17ae0a-1bb1-4979-a11b-bcee0aa3f50c"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:06.460595 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-f6079c72-a8b2-4ede-afb2-0e8a43f211e6 req-9f26c9df-4a61-4715-bd29-bd5fb6c245b3 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:06.461210 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-f6079c72-a8b2-4ede-afb2-0e8a43f211e6 req-9f26c9df-4a61-4715-bd29-bd5fb6c245b3 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:06.474759 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-f6079c72-a8b2-4ede-afb2-0e8a43f211e6 req-9f26c9df-4a61-4715-bd29-bd5fb6c245b3 service nova] Creating event network-changed:ca17ae0a-1bb1-4979-a11b-bcee0aa3f50c for instance a0498aab-f458-4907-8557-c094918d4cdd on hv-cinder-76606 May 16 19:14:06.480149 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-f6079c72-a8b2-4ede-afb2-0e8a43f211e6 req-9f26c9df-4a61-4715-bd29-bd5fb6c245b3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031728 May 16 19:14:06.481377 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 424/871] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:06.728602 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b40bc9a6-12a2-4b2c-b3d5-a55d634b15f9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:06.729351 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b40bc9a6-12a2-4b2c-b3d5-a55d634b15f9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:06.736333 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b40bc9a6-12a2-4b2c-b3d5-a55d634b15f9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:06.736876 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b40bc9a6-12a2-4b2c-b3d5-a55d634b15f9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:06.737563 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b40bc9a6-12a2-4b2c-b3d5-a55d634b15f9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:06.738024 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b40bc9a6-12a2-4b2c-b3d5-a55d634b15f9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:06.879205 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b40bc9a6-12a2-4b2c-b3d5-a55d634b15f9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:06.887542 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b40bc9a6-12a2-4b2c-b3d5-a55d634b15f9 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1367 microversion: 2.1 time: 0.163060 May 16 19:14:06.888108 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 448/872] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:06 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:07.060606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-18e347cf-e22f-4099-af92-ef674e4d1659 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:07.061671 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-18e347cf-e22f-4099-af92-ef674e4d1659 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:07.072077 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-18e347cf-e22f-4099-af92-ef674e4d1659 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:07.072588 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-18e347cf-e22f-4099-af92-ef674e4d1659 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:07.073513 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-18e347cf-e22f-4099-af92-ef674e4d1659 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:07.073977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-18e347cf-e22f-4099-af92-ef674e4d1659 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:07.209194 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-18e347cf-e22f-4099-af92-ef674e4d1659 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:07.221592 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-18e347cf-e22f-4099-af92-ef674e4d1659 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1264 microversion: 2.1 time: 0.167603 May 16 19:14:07.222365 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 425/873] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:07 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:07.599131 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-1a58879e-1ed7-4364-b4ef-bc07a5c22021 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:07.599852 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-1a58879e-1ed7-4364-b4ef-bc07a5c22021 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:07.609035 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1a58879e-1ed7-4364-b4ef-bc07a5c22021 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:07.609743 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1a58879e-1ed7-4364-b4ef-bc07a5c22021 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:07.610872 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1a58879e-1ed7-4364-b4ef-bc07a5c22021 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:07.611507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1a58879e-1ed7-4364-b4ef-bc07a5c22021 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:07.637212 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-1a58879e-1ed7-4364-b4ef-bc07a5c22021 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5/ips" status: 200 len: 152 microversion: 2.20 time: 0.044497 May 16 19:14:07.637880 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 449/874] 10.222.0.24 () {60 vars in 1288 bytes} [Mon May 16 19:14:07 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 19:14:07.904993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9255e099-9ce1-4e61-872e-9fb8fe17111f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:07.905647 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9255e099-9ce1-4e61-872e-9fb8fe17111f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:07.912483 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9255e099-9ce1-4e61-872e-9fb8fe17111f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:07.913131 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9255e099-9ce1-4e61-872e-9fb8fe17111f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:07.913944 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9255e099-9ce1-4e61-872e-9fb8fe17111f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:07.914359 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9255e099-9ce1-4e61-872e-9fb8fe17111f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:08.240496 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9eaf5821-32d8-4b5b-8000-e80fde8b43c7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:08.241219 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9eaf5821-32d8-4b5b-8000-e80fde8b43c7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:08.248135 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9eaf5821-32d8-4b5b-8000-e80fde8b43c7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:08.248592 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9eaf5821-32d8-4b5b-8000-e80fde8b43c7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:08.249390 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9eaf5821-32d8-4b5b-8000-e80fde8b43c7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:08.249893 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9eaf5821-32d8-4b5b-8000-e80fde8b43c7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:08.258768 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-9255e099-9ce1-4e61-872e-9fb8fe17111f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:08.267230 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9255e099-9ce1-4e61-872e-9fb8fe17111f tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1367 microversion: 2.1 time: 0.366403 May 16 19:14:08.267825 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 426/875] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:07 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:08.387003 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9eaf5821-32d8-4b5b-8000-e80fde8b43c7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:08.395069 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9eaf5821-32d8-4b5b-8000-e80fde8b43c7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1264 microversion: 2.1 time: 0.158587 May 16 19:14:08.395642 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 450/876] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:08 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:08.737937 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d917b291-bb83-4d9c-b68b-605109b4c0d0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:08.738585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d917b291-bb83-4d9c-b68b-605109b4c0d0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:08.747733 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d917b291-bb83-4d9c-b68b-605109b4c0d0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:08.748378 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d917b291-bb83-4d9c-b68b-605109b4c0d0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:08.749598 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d917b291-bb83-4d9c-b68b-605109b4c0d0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:08.750249 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d917b291-bb83-4d9c-b68b-605109b4c0d0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:08.835084 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.objects.instance [None req-d917b291-bb83-4d9c-b68b-605109b4c0d0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lazy-loading 'services' on Instance uuid eeb4d6c5-966a-44b0-a092-602b55ec665c {{(pid=117275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:14:08.909174 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d917b291-bb83-4d9c-b68b-605109b4c0d0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "DELETE /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/os-volume_attachments/cd21ee13-a791-4160-b7f2-11b738849ebf" status: 202 len: 0 microversion: 2.1 time: 0.177447 May 16 19:14:08.910352 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 427/877] 10.222.0.24 () {58 vars in 1415 bytes} [Mon May 16 19:14:08 2022] DELETE /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/os-volume_attachments/cd21ee13-a791-4160-b7f2-11b738849ebf => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:14:08.920319 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8341ed57-f14b-47c7-a8d3-dae83f6678d6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:08.921085 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8341ed57-f14b-47c7-a8d3-dae83f6678d6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:08.927830 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8341ed57-f14b-47c7-a8d3-dae83f6678d6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:08.928670 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8341ed57-f14b-47c7-a8d3-dae83f6678d6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:08.930156 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8341ed57-f14b-47c7-a8d3-dae83f6678d6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:08.930752 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8341ed57-f14b-47c7-a8d3-dae83f6678d6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:08.966178 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8341ed57-f14b-47c7-a8d3-dae83f6678d6 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051523 May 16 19:14:08.966942 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 451/878] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:14:08 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:09.290435 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b793d6aa-e682-49cc-901d-42df5de13972 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:09.291546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b793d6aa-e682-49cc-901d-42df5de13972 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:09.298724 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b793d6aa-e682-49cc-901d-42df5de13972 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:09.299191 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b793d6aa-e682-49cc-901d-42df5de13972 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:09.299992 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b793d6aa-e682-49cc-901d-42df5de13972 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:09.300444 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b793d6aa-e682-49cc-901d-42df5de13972 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:09.412245 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c13978bb-49e4-43d7-a765-6b1a0dae5a55 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:09.413495 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c13978bb-49e4-43d7-a765-6b1a0dae5a55 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:09.420265 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c13978bb-49e4-43d7-a765-6b1a0dae5a55 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:09.420732 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c13978bb-49e4-43d7-a765-6b1a0dae5a55 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:09.421559 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c13978bb-49e4-43d7-a765-6b1a0dae5a55 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:09.421989 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c13978bb-49e4-43d7-a765-6b1a0dae5a55 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:09.433215 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b793d6aa-e682-49cc-901d-42df5de13972 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:09.443058 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b793d6aa-e682-49cc-901d-42df5de13972 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1367 microversion: 2.1 time: 0.160606 May 16 19:14:09.443726 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 428/879] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:09 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:09.579027 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c13978bb-49e4-43d7-a765-6b1a0dae5a55 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:09.587072 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c13978bb-49e4-43d7-a765-6b1a0dae5a55 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1264 microversion: 2.1 time: 0.178804 May 16 19:14:09.587973 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 452/880] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:09 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:14:09.695994 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-da6af260-742a-4a98-9c49-137978ead914 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:09.696749 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-da6af260-742a-4a98-9c49-137978ead914 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:09.707434 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-da6af260-742a-4a98-9c49-137978ead914 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:09.708056 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-da6af260-742a-4a98-9c49-137978ead914 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:09.709953 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-da6af260-742a-4a98-9c49-137978ead914 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:09.710760 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-da6af260-742a-4a98-9c49-137978ead914 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:09.734657 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.objects.instance [None req-da6af260-742a-4a98-9c49-137978ead914 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lazy-loading 'flavor' on Instance uuid b664a08c-f97e-4c52-b849-9eddb2e65be5 {{(pid=117275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:14:09.979324 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2c2f1249-6ca5-4f20-b5fd-2f9970eea550 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:09.980777 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2c2f1249-6ca5-4f20-b5fd-2f9970eea550 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:09.986966 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c2f1249-6ca5-4f20-b5fd-2f9970eea550 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:09.987409 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c2f1249-6ca5-4f20-b5fd-2f9970eea550 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:09.988213 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c2f1249-6ca5-4f20-b5fd-2f9970eea550 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:09.988647 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2c2f1249-6ca5-4f20-b5fd-2f9970eea550 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:09.995307 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-da6af260-742a-4a98-9c49-137978ead914 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "POST /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5/action" status: 202 len: 0 microversion: 2.20 time: 0.305405 May 16 19:14:09.995944 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 429/881] 10.222.0.24 () {62 vars in 1318 bytes} [Mon May 16 19:14:09 2022] POST /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 19:14:10.004227 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-84b4fb78-c172-4783-ab54-8a36a1cad370 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:10.004920 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-84b4fb78-c172-4783-ab54-8a36a1cad370 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:10.011413 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-84b4fb78-c172-4783-ab54-8a36a1cad370 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:10.011858 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-84b4fb78-c172-4783-ab54-8a36a1cad370 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:10.012618 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-84b4fb78-c172-4783-ab54-8a36a1cad370 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:10.013160 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-84b4fb78-c172-4783-ab54-8a36a1cad370 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:10.023203 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2c2f1249-6ca5-4f20-b5fd-2f9970eea550 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048028 May 16 19:14:10.025564 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 453/882] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:14:09 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 16 19:14:10.107764 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e80509a6-919d-42ef-89f3-53cbe53d6cfe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:10.108488 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e80509a6-919d-42ef-89f3-53cbe53d6cfe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:10.114783 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e80509a6-919d-42ef-89f3-53cbe53d6cfe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:10.115480 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e80509a6-919d-42ef-89f3-53cbe53d6cfe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:10.116266 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e80509a6-919d-42ef-89f3-53cbe53d6cfe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:10.116697 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e80509a6-919d-42ef-89f3-53cbe53d6cfe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:10.142281 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e80509a6-919d-42ef-89f3-53cbe53d6cfe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Going to try to terminate instance {{(pid=117274) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:14:10.163101 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-84b4fb78-c172-4783-ab54-8a36a1cad370 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:10.173418 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-84b4fb78-c172-4783-ab54-8a36a1cad370 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:10.174993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-84b4fb78-c172-4783-ab54-8a36a1cad370 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:10.176178 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-84b4fb78-c172-4783-ab54-8a36a1cad370 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1724 microversion: 2.20 time: 0.176019 May 16 19:14:10.176753 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 430/883] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:09 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:10.219874 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e80509a6-919d-42ef-89f3-53cbe53d6cfe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "DELETE /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 204 len: 0 microversion: 2.1 time: 0.115858 May 16 19:14:10.220457 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 454/884] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:14:10 2022] DELETE /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 19:14:10.229512 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-cf57e40b-7208-49b7-80d7-0f9609b9bb0d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:10.230162 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-cf57e40b-7208-49b7-80d7-0f9609b9bb0d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:10.236811 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cf57e40b-7208-49b7-80d7-0f9609b9bb0d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:10.237248 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cf57e40b-7208-49b7-80d7-0f9609b9bb0d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:10.238057 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cf57e40b-7208-49b7-80d7-0f9609b9bb0d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:10.238494 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cf57e40b-7208-49b7-80d7-0f9609b9bb0d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:10.376703 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-cf57e40b-7208-49b7-80d7-0f9609b9bb0d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:10.387924 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-cf57e40b-7208-49b7-80d7-0f9609b9bb0d tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1689 microversion: 2.1 time: 0.162557 May 16 19:14:10.388673 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 431/885] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:10 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:10.464615 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2a64c3ca-272a-4fb5-9ba1-48dfb7b1819b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:10.465474 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2a64c3ca-272a-4fb5-9ba1-48dfb7b1819b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:10.473902 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2a64c3ca-272a-4fb5-9ba1-48dfb7b1819b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:10.474464 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2a64c3ca-272a-4fb5-9ba1-48dfb7b1819b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:10.475439 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2a64c3ca-272a-4fb5-9ba1-48dfb7b1819b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:10.475986 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2a64c3ca-272a-4fb5-9ba1-48dfb7b1819b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:10.603635 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f037b561-1fee-4b79-bc2e-3762278fc919 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:10.604122 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f037b561-1fee-4b79-bc2e-3762278fc919 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:10.610929 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f037b561-1fee-4b79-bc2e-3762278fc919 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:10.611364 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f037b561-1fee-4b79-bc2e-3762278fc919 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:10.611815 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2a64c3ca-272a-4fb5-9ba1-48dfb7b1819b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:10.612804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f037b561-1fee-4b79-bc2e-3762278fc919 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:10.613235 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f037b561-1fee-4b79-bc2e-3762278fc919 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:10.620470 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2a64c3ca-272a-4fb5-9ba1-48dfb7b1819b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1367 microversion: 2.1 time: 0.162465 May 16 19:14:10.621135 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 455/886] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:10 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:10.753769 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f037b561-1fee-4b79-bc2e-3762278fc919 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:10.762308 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f037b561-1fee-4b79-bc2e-3762278fc919 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1264 microversion: 2.1 time: 0.162666 May 16 19:14:10.762886 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 432/887] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:10 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:11.196588 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a69383a9-cb68-4ea2-812c-a202e28cae45 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:11.197178 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a69383a9-cb68-4ea2-812c-a202e28cae45 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:11.204025 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a69383a9-cb68-4ea2-812c-a202e28cae45 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:11.204508 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a69383a9-cb68-4ea2-812c-a202e28cae45 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:11.205657 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a69383a9-cb68-4ea2-812c-a202e28cae45 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:11.206106 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a69383a9-cb68-4ea2-812c-a202e28cae45 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:11.370062 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a69383a9-cb68-4ea2-812c-a202e28cae45 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:11.378998 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a69383a9-cb68-4ea2-812c-a202e28cae45 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:11.380514 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a69383a9-cb68-4ea2-812c-a202e28cae45 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:11.381925 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a69383a9-cb68-4ea2-812c-a202e28cae45 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1724 microversion: 2.20 time: 0.189142 May 16 19:14:11.383217 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 456/888] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:11 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:11.405874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b36ef348-7bc4-44cd-be6a-fe69113fa46c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:11.407087 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b36ef348-7bc4-44cd-be6a-fe69113fa46c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:11.415650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b36ef348-7bc4-44cd-be6a-fe69113fa46c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:11.416343 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b36ef348-7bc4-44cd-be6a-fe69113fa46c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:11.417480 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b36ef348-7bc4-44cd-be6a-fe69113fa46c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:11.418008 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b36ef348-7bc4-44cd-be6a-fe69113fa46c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:11.560627 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b36ef348-7bc4-44cd-be6a-fe69113fa46c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:11.573957 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b36ef348-7bc4-44cd-be6a-fe69113fa46c tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1689 microversion: 2.1 time: 0.171972 May 16 19:14:11.574539 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 433/889] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:11 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:11.638713 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3071a841-0c94-4e5e-b87a-b286b1ff396e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:11.639314 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-3071a841-0c94-4e5e-b87a-b286b1ff396e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:11.646011 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3071a841-0c94-4e5e-b87a-b286b1ff396e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:11.646456 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3071a841-0c94-4e5e-b87a-b286b1ff396e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:11.647252 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3071a841-0c94-4e5e-b87a-b286b1ff396e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:11.647645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3071a841-0c94-4e5e-b87a-b286b1ff396e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:11.679016 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-15c4a54f-67af-43e8-aff3-1b088c749478 req-5b3bc44a-f507-41ca-85d8-7899d25844e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0498aab-f458-4907-8557-c094918d4cdd", "name": "network-vif-plugged", "status": "completed", "tag": "ca17ae0a-1bb1-4979-a11b-bcee0aa3f50c"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:11.689237 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-15c4a54f-67af-43e8-aff3-1b088c749478 req-5b3bc44a-f507-41ca-85d8-7899d25844e7 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:11.689778 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-15c4a54f-67af-43e8-aff3-1b088c749478 req-5b3bc44a-f507-41ca-85d8-7899d25844e7 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:11.702424 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-15c4a54f-67af-43e8-aff3-1b088c749478 req-5b3bc44a-f507-41ca-85d8-7899d25844e7 service nova] Creating event network-vif-plugged:ca17ae0a-1bb1-4979-a11b-bcee0aa3f50c for instance a0498aab-f458-4907-8557-c094918d4cdd on hv-cinder-76606 May 16 19:14:11.707250 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-15c4a54f-67af-43e8-aff3-1b088c749478 req-5b3bc44a-f507-41ca-85d8-7899d25844e7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094963 May 16 19:14:11.707958 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 457/890] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:11.780988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-de89a705-080a-4b33-9b04-afb9114f38d0 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:11.781694 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-de89a705-080a-4b33-9b04-afb9114f38d0 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:11.786879 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-3071a841-0c94-4e5e-b87a-b286b1ff396e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:11.788967 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-de89a705-080a-4b33-9b04-afb9114f38d0 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:11.789446 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-de89a705-080a-4b33-9b04-afb9114f38d0 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:11.790702 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-de89a705-080a-4b33-9b04-afb9114f38d0 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:11.790842 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-de89a705-080a-4b33-9b04-afb9114f38d0 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:11.794814 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-3071a841-0c94-4e5e-b87a-b286b1ff396e tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1367 microversion: 2.1 time: 0.160487 May 16 19:14:11.795398 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 434/891] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:11 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:14:11.926696 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-de89a705-080a-4b33-9b04-afb9114f38d0 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:11.934973 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-de89a705-080a-4b33-9b04-afb9114f38d0 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1264 microversion: 2.1 time: 0.158228 May 16 19:14:11.935661 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 458/892] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:11 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:12.405395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f57e6411-8222-4688-b6bd-8283fc8fe983 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:12.406341 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f57e6411-8222-4688-b6bd-8283fc8fe983 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:12.416578 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f57e6411-8222-4688-b6bd-8283fc8fe983 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:12.417020 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f57e6411-8222-4688-b6bd-8283fc8fe983 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:12.417826 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f57e6411-8222-4688-b6bd-8283fc8fe983 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:12.418257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f57e6411-8222-4688-b6bd-8283fc8fe983 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:12.560018 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f57e6411-8222-4688-b6bd-8283fc8fe983 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:12.571775 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f57e6411-8222-4688-b6bd-8283fc8fe983 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:12.573758 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f57e6411-8222-4688-b6bd-8283fc8fe983 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:12.575558 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f57e6411-8222-4688-b6bd-8283fc8fe983 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1724 microversion: 2.20 time: 0.176541 May 16 19:14:12.576406 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 435/893] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:12 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:12.591620 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-33b238d8-d2b3-43c0-8dda-5cb4c4726a0e tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:12.592238 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-33b238d8-d2b3-43c0-8dda-5cb4c4726a0e tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:12.598772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-33b238d8-d2b3-43c0-8dda-5cb4c4726a0e tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:12.599213 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-33b238d8-d2b3-43c0-8dda-5cb4c4726a0e tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:12.599977 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-33b238d8-d2b3-43c0-8dda-5cb4c4726a0e tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:12.600406 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-33b238d8-d2b3-43c0-8dda-5cb4c4726a0e tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:12.729986 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-33b238d8-d2b3-43c0-8dda-5cb4c4726a0e tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:12.738184 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-33b238d8-d2b3-43c0-8dda-5cb4c4726a0e tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1689 microversion: 2.1 time: 0.150471 May 16 19:14:12.738756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 459/894] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:12 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:12.815219 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e2cae7d2-7a55-4ab0-a715-227c1520d54b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:12.816218 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e2cae7d2-7a55-4ab0-a715-227c1520d54b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:12.826743 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e2cae7d2-7a55-4ab0-a715-227c1520d54b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:12.827481 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e2cae7d2-7a55-4ab0-a715-227c1520d54b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:12.828755 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e2cae7d2-7a55-4ab0-a715-227c1520d54b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:12.829454 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e2cae7d2-7a55-4ab0-a715-227c1520d54b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:12.952549 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b5483ff4-a4cf-4a87-998f-7b6a681530a8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:12.953058 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b5483ff4-a4cf-4a87-998f-7b6a681530a8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:12.959382 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b5483ff4-a4cf-4a87-998f-7b6a681530a8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:12.959835 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b5483ff4-a4cf-4a87-998f-7b6a681530a8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:12.960609 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b5483ff4-a4cf-4a87-998f-7b6a681530a8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:12.961045 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b5483ff4-a4cf-4a87-998f-7b6a681530a8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:12.969469 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e2cae7d2-7a55-4ab0-a715-227c1520d54b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:12.976952 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e2cae7d2-7a55-4ab0-a715-227c1520d54b tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1367 microversion: 2.1 time: 0.168217 May 16 19:14:12.977553 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 436/895] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:12 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:13.104294 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b5483ff4-a4cf-4a87-998f-7b6a681530a8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:13.111862 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b5483ff4-a4cf-4a87-998f-7b6a681530a8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1264 microversion: 2.1 time: 0.163504 May 16 19:14:13.112467 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 460/896] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:12 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:13.597899 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5d5caca3-8b43-4a7d-973d-2fb0fd4f2588 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:13.598512 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5d5caca3-8b43-4a7d-973d-2fb0fd4f2588 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:13.605408 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d5caca3-8b43-4a7d-973d-2fb0fd4f2588 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:13.605887 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d5caca3-8b43-4a7d-973d-2fb0fd4f2588 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:13.606658 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d5caca3-8b43-4a7d-973d-2fb0fd4f2588 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:13.607095 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d5caca3-8b43-4a7d-973d-2fb0fd4f2588 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:13.743740 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5d5caca3-8b43-4a7d-973d-2fb0fd4f2588 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:13.754231 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5d5caca3-8b43-4a7d-973d-2fb0fd4f2588 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:13.755882 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5d5caca3-8b43-4a7d-973d-2fb0fd4f2588 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:13.757090 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5d5caca3-8b43-4a7d-973d-2fb0fd4f2588 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1724 microversion: 2.20 time: 0.163243 May 16 19:14:13.757260 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-6e889ea8-25d6-4b29-a798-503b38a39a68 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:13.767839 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 437/897] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:13 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:13.767994 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-6e889ea8-25d6-4b29-a798-503b38a39a68 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:13.767994 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6e889ea8-25d6-4b29-a798-503b38a39a68 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:13.767994 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6e889ea8-25d6-4b29-a798-503b38a39a68 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:13.767994 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6e889ea8-25d6-4b29-a798-503b38a39a68 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:13.768345 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6e889ea8-25d6-4b29-a798-503b38a39a68 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:13.905139 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-6e889ea8-25d6-4b29-a798-503b38a39a68 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:13.912782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-6e889ea8-25d6-4b29-a798-503b38a39a68 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1689 microversion: 2.1 time: 0.159375 May 16 19:14:13.913369 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 461/898] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:13 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:14:13.997613 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-dc7022dd-fe65-442c-84d7-04dfdc02e1e6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:13.998656 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-dc7022dd-fe65-442c-84d7-04dfdc02e1e6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:14.009091 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dc7022dd-fe65-442c-84d7-04dfdc02e1e6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:14.009993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dc7022dd-fe65-442c-84d7-04dfdc02e1e6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:14.010762 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dc7022dd-fe65-442c-84d7-04dfdc02e1e6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:14.011198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-dc7022dd-fe65-442c-84d7-04dfdc02e1e6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:14.129776 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-6cb42339-c344-481b-b821-828adb4bc9cf tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:14.130475 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-6cb42339-c344-481b-b821-828adb4bc9cf tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:14.136947 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6cb42339-c344-481b-b821-828adb4bc9cf tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:14.137402 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6cb42339-c344-481b-b821-828adb4bc9cf tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:14.138209 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6cb42339-c344-481b-b821-828adb4bc9cf tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:14.138670 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6cb42339-c344-481b-b821-828adb4bc9cf tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:14.148863 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-dc7022dd-fe65-442c-84d7-04dfdc02e1e6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:14.156869 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-dc7022dd-fe65-442c-84d7-04dfdc02e1e6 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1367 microversion: 2.1 time: 0.165666 May 16 19:14:14.157450 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 438/899] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:13 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:14.275843 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-6cb42339-c344-481b-b821-828adb4bc9cf tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:14.283581 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-6cb42339-c344-481b-b821-828adb4bc9cf tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1264 microversion: 2.1 time: 0.157938 May 16 19:14:14.284125 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 462/900] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:14 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:14.776133 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-469b786f-38aa-40b5-91e9-4484d1ec24ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:14.776830 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-469b786f-38aa-40b5-91e9-4484d1ec24ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:14.783549 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-469b786f-38aa-40b5-91e9-4484d1ec24ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:14.784098 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-469b786f-38aa-40b5-91e9-4484d1ec24ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:14.784952 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-469b786f-38aa-40b5-91e9-4484d1ec24ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:14.785383 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-469b786f-38aa-40b5-91e9-4484d1ec24ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:14.929999 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-296c9245-6a81-4ccb-88bc-aa253130e4cc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:14.930583 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-296c9245-6a81-4ccb-88bc-aa253130e4cc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:14.937735 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-296c9245-6a81-4ccb-88bc-aa253130e4cc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:14.938177 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-296c9245-6a81-4ccb-88bc-aa253130e4cc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:14.938945 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-296c9245-6a81-4ccb-88bc-aa253130e4cc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:14.939378 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-296c9245-6a81-4ccb-88bc-aa253130e4cc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:15.076682 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-296c9245-6a81-4ccb-88bc-aa253130e4cc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:15.084976 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-296c9245-6a81-4ccb-88bc-aa253130e4cc tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1689 microversion: 2.1 time: 0.158885 May 16 19:14:15.085767 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 463/901] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:14 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:15.174184 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-85235fa8-8553-4b22-ad9e-6a4d93ea3bdb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:15.174797 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-85235fa8-8553-4b22-ad9e-6a4d93ea3bdb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:15.181674 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-85235fa8-8553-4b22-ad9e-6a4d93ea3bdb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:15.182126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-85235fa8-8553-4b22-ad9e-6a4d93ea3bdb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:15.182944 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-85235fa8-8553-4b22-ad9e-6a4d93ea3bdb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:15.183351 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-85235fa8-8553-4b22-ad9e-6a4d93ea3bdb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:15.292147 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-469b786f-38aa-40b5-91e9-4484d1ec24ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:15.300128 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-469b786f-38aa-40b5-91e9-4484d1ec24ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:15.301651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-469b786f-38aa-40b5-91e9-4484d1ec24ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:15.302806 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-469b786f-38aa-40b5-91e9-4484d1ec24ab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1724 microversion: 2.20 time: 0.530650 May 16 19:14:15.307886 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 439/902] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:14 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1724 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:15.307886 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-362e5559-7d76-478c-b928-a867863585ba tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:15.308461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-362e5559-7d76-478c-b928-a867863585ba tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:15.314406 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-362e5559-7d76-478c-b928-a867863585ba tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:15.314853 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-362e5559-7d76-478c-b928-a867863585ba tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:15.315633 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-362e5559-7d76-478c-b928-a867863585ba tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:15.316066 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-362e5559-7d76-478c-b928-a867863585ba tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:15.321228 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-85235fa8-8553-4b22-ad9e-6a4d93ea3bdb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:15.329477 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-85235fa8-8553-4b22-ad9e-6a4d93ea3bdb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1367 microversion: 2.1 time: 0.159262 May 16 19:14:15.330363 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 464/903] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:15 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:15.560593 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-362e5559-7d76-478c-b928-a867863585ba tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:15.568245 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-362e5559-7d76-478c-b928-a867863585ba tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1264 microversion: 2.1 time: 0.263868 May 16 19:14:15.568900 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 440/904] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:15 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1264 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:15.944139 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-fdd02f6c-e8c8-4936-ada6-7108fb173f94 req-609eb66d-0ed6-49ae-890a-26b761efa4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb4d6c5-966a-44b0-a092-602b55ec665c", "name": "network-vif-deleted", "tag": "2f53d2f3-16ec-408d-b308-a79d7b29c2e9"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:15.952826 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-fdd02f6c-e8c8-4936-ada6-7108fb173f94 req-609eb66d-0ed6-49ae-890a-26b761efa4bd service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:15.953272 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-fdd02f6c-e8c8-4936-ada6-7108fb173f94 req-609eb66d-0ed6-49ae-890a-26b761efa4bd service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:15.964698 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-fdd02f6c-e8c8-4936-ada6-7108fb173f94 req-609eb66d-0ed6-49ae-890a-26b761efa4bd service nova] Creating event network-vif-deleted:2f53d2f3-16ec-408d-b308-a79d7b29c2e9 for instance eeb4d6c5-966a-44b0-a092-602b55ec665c on hv-cinder-76606 May 16 19:14:15.970093 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-fdd02f6c-e8c8-4936-ada6-7108fb173f94 req-609eb66d-0ed6-49ae-890a-26b761efa4bd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029747 May 16 19:14:15.970929 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 465/905] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:16.104183 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-7219c63e-0777-40ca-ba08-a6a660ace44f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:16.106160 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-7219c63e-0777-40ca-ba08-a6a660ace44f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:16.116147 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7219c63e-0777-40ca-ba08-a6a660ace44f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:16.117786 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7219c63e-0777-40ca-ba08-a6a660ace44f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:16.119107 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7219c63e-0777-40ca-ba08-a6a660ace44f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:16.119797 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7219c63e-0777-40ca-ba08-a6a660ace44f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:16.166918 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7219c63e-0777-40ca-ba08-a6a660ace44f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:16.167600 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7219c63e-0777-40ca-ba08-a6a660ace44f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:16.168250 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.objects.instance [None req-7219c63e-0777-40ca-ba08-a6a660ace44f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lazy-loading 'fault' on Instance uuid eeb4d6c5-966a-44b0-a092-602b55ec665c {{(pid=117275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:14:16.219002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-7219c63e-0777-40ca-ba08-a6a660ace44f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:16.226888 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-7219c63e-0777-40ca-ba08-a6a660ace44f tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 200 len: 1335 microversion: 2.1 time: 0.128343 May 16 19:14:16.227732 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 441/906] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:16 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 1335 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:14:16.323133 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e72dfdb2-f59f-4825-ab20-fe5eae697dfd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:16.323759 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e72dfdb2-f59f-4825-ab20-fe5eae697dfd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:16.330410 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e72dfdb2-f59f-4825-ab20-fe5eae697dfd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:16.330863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e72dfdb2-f59f-4825-ab20-fe5eae697dfd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:16.331685 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e72dfdb2-f59f-4825-ab20-fe5eae697dfd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:16.332094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e72dfdb2-f59f-4825-ab20-fe5eae697dfd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:16.347198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9d9904de-6911-41ba-9e47-0f79bb7c5527 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:16.348126 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9d9904de-6911-41ba-9e47-0f79bb7c5527 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:16.354979 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9d9904de-6911-41ba-9e47-0f79bb7c5527 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:16.355420 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9d9904de-6911-41ba-9e47-0f79bb7c5527 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:16.356193 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9d9904de-6911-41ba-9e47-0f79bb7c5527 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:16.356619 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9d9904de-6911-41ba-9e47-0f79bb7c5527 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:16.476092 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e72dfdb2-f59f-4825-ab20-fe5eae697dfd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:16.486327 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e72dfdb2-f59f-4825-ab20-fe5eae697dfd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:16.488889 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e72dfdb2-f59f-4825-ab20-fe5eae697dfd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:16.490486 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e72dfdb2-f59f-4825-ab20-fe5eae697dfd tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1724 microversion: 2.20 time: 0.171835 May 16 19:14:16.500453 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 466/907] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:16 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:16.507251 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-9d9904de-6911-41ba-9e47-0f79bb7c5527 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:16.517151 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9d9904de-6911-41ba-9e47-0f79bb7c5527 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1367 microversion: 2.1 time: 0.173873 May 16 19:14:16.518124 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 442/908] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:16 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:16.586203 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5c6d1ad1-aa9d-4608-82e0-27f24754352d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:16.586813 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5c6d1ad1-aa9d-4608-82e0-27f24754352d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:16.595024 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5c6d1ad1-aa9d-4608-82e0-27f24754352d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:16.595583 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5c6d1ad1-aa9d-4608-82e0-27f24754352d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:16.596374 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5c6d1ad1-aa9d-4608-82e0-27f24754352d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:16.596809 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5c6d1ad1-aa9d-4608-82e0-27f24754352d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:16.725713 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-5c6d1ad1-aa9d-4608-82e0-27f24754352d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:16.733766 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-5c6d1ad1-aa9d-4608-82e0-27f24754352d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1264 microversion: 2.1 time: 0.152439 May 16 19:14:16.734345 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 467/909] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:16 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:17.248757 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-012c762a-5fc3-4bcb-952d-0fd4fdb99559 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:17.249731 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-012c762a-5fc3-4bcb-952d-0fd4fdb99559 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: eeb4d6c5-966a-44b0-a092-602b55ec665c] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:17.260380 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-012c762a-5fc3-4bcb-952d-0fd4fdb99559 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:17.261135 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-012c762a-5fc3-4bcb-952d-0fd4fdb99559 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:17.262474 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-012c762a-5fc3-4bcb-952d-0fd4fdb99559 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:17.263207 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-012c762a-5fc3-4bcb-952d-0fd4fdb99559 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:17.282834 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-012c762a-5fc3-4bcb-952d-0fd4fdb99559 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] HTTP exception thrown: Instance eeb4d6c5-966a-44b0-a092-602b55ec665c could not be found. May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-012c762a-5fc3-4bcb-952d-0fd4fdb99559 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Request method failure captured: May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c HTTP/1.1 May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqEpTPlBWWpGAb8naoUtmT0kghhiI3kimMzn0_IWG3sCJkSvB5xO-7IGvOFSSINkqC-urNwmtwl2u96aKU3xl-Dex2fmV-bVO4ktBC40rbYPJQDH7eWDNSupKRIkwS3ds8fzriCvEWSDHbsHMvvS0L95hwszzciSeDbpHSrW4xtsOro May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: ba2c6e5fee5b402fa68833228d12c8e7 May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-949694738 May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:14:17.284535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:14:17.286104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:14:17.286104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-ServerRescueNegativeTestJSON-949694738 May 16 19:14:17.286104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: ba2c6e5fee5b402fa68833228d12c8e7 May 16 19:14:17.286104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-949694738 May 16 19:14:17.286104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-ServerRescueNegativeTestJSON-949694738-project May 16 19:14:17.286104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:14:17.286104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:14:17.286104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 1673e91c8910435499a5d587f4ef59f9 May 16 19:14:17.286104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-ServerRescueNegativeTestJSON-949694738-project May 16 19:14:17.286104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:14:17.286104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance eeb4d6c5-966a-44b0-a092-602b55ec665c could not be found. May 16 19:14:17.286104 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': 'eeb4d6c5-966a-44b0-a092-602b55ec665c'} May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb4d6c5-966a-44b0-a092-602b55ec665c could not be found. May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:14:17.286859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb4d6c5-966a-44b0-a092-602b55ec665c could not be found. May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb4d6c5-966a-44b0-a092-602b55ec665c could not be found. May 16 19:14:17.288078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:14:17.289209 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-012c762a-5fc3-4bcb-952d-0fd4fdb99559 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Returning 404 to user: Instance eeb4d6c5-966a-44b0-a092-602b55ec665c could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:14:17.289209 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-012c762a-5fc3-4bcb-952d-0fd4fdb99559 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c" status: 404 len: 111 microversion: 2.1 time: 0.043883 May 16 19:14:17.289209 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 443/910] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:17 2022] GET /compute/v2.1/servers/eeb4d6c5-966a-44b0-a092-602b55ec665c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:14:17.295119 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-cd7329b3-1ced-4e11-b804-464c0c13bcea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '.version_select at 0x7f1e185e7dc0>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:17.314424 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-cd7329b3-1ced-4e11-b804-464c0c13bcea tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1726969247" status: 202 len: 0 microversion: 2.1 time: 0.023342 May 16 19:14:17.314976 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 468/911] 10.222.0.24 () {58 vars in 1220 bytes} [Mon May 16 19:14:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1726969247 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:14:17.508489 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8d8c7a49-43cd-4251-95a0-97e7396a656f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:17.509423 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8d8c7a49-43cd-4251-95a0-97e7396a656f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:17.516260 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8d8c7a49-43cd-4251-95a0-97e7396a656f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:17.516891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8d8c7a49-43cd-4251-95a0-97e7396a656f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:17.517962 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8d8c7a49-43cd-4251-95a0-97e7396a656f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:17.518543 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8d8c7a49-43cd-4251-95a0-97e7396a656f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:17.524284 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-930084b8-2057-450d-8351-3307c0404e81 req-bf6943a1-5894-4f13-accb-231542817417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3e480e-c9ee-46ba-8393-c289b3fee9eb", "name": "network-vif-plugged", "status": "completed", "tag": "b4806342-52fb-4a7f-bc66-ac85ae8e8213"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:17.540420 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-930084b8-2057-450d-8351-3307c0404e81 req-bf6943a1-5894-4f13-accb-231542817417 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:17.541788 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-930084b8-2057-450d-8351-3307c0404e81 req-bf6943a1-5894-4f13-accb-231542817417 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:17.554114 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-930084b8-2057-450d-8351-3307c0404e81 req-bf6943a1-5894-4f13-accb-231542817417 service nova] Creating event network-vif-plugged:b4806342-52fb-4a7f-bc66-ac85ae8e8213 for instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb on hv-cinder-76606 May 16 19:14:17.560569 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-930084b8-2057-450d-8351-3307c0404e81 req-bf6943a1-5894-4f13-accb-231542817417 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041425 May 16 19:14:17.562327 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 469/912] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:14:17.568952 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e6b7b99c-d9bd-4ece-ac4b-ff8ec4fa4deb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:17.581044 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e6b7b99c-d9bd-4ece-ac4b-ff8ec4fa4deb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:17.589160 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e6b7b99c-d9bd-4ece-ac4b-ff8ec4fa4deb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:17.589652 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e6b7b99c-d9bd-4ece-ac4b-ff8ec4fa4deb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:17.590733 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e6b7b99c-d9bd-4ece-ac4b-ff8ec4fa4deb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:17.591559 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e6b7b99c-d9bd-4ece-ac4b-ff8ec4fa4deb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:17.677038 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8d8c7a49-43cd-4251-95a0-97e7396a656f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:17.686542 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8d8c7a49-43cd-4251-95a0-97e7396a656f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:17.688041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8d8c7a49-43cd-4251-95a0-97e7396a656f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:17.689240 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8d8c7a49-43cd-4251-95a0-97e7396a656f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1724 microversion: 2.20 time: 0.184860 May 16 19:14:17.690141 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 444/913] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:17 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:14:17.750977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4dd463cf-f3e8-4b72-9258-4aac862ae7bc tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:17.751762 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-4dd463cf-f3e8-4b72-9258-4aac862ae7bc tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:17.759168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4dd463cf-f3e8-4b72-9258-4aac862ae7bc tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:17.759774 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4dd463cf-f3e8-4b72-9258-4aac862ae7bc tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:17.760848 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4dd463cf-f3e8-4b72-9258-4aac862ae7bc tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:17.761288 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4dd463cf-f3e8-4b72-9258-4aac862ae7bc tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:17.808649 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e6b7b99c-d9bd-4ece-ac4b-ff8ec4fa4deb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:17.817204 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e6b7b99c-d9bd-4ece-ac4b-ff8ec4fa4deb tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1556 microversion: 2.1 time: 0.252923 May 16 19:14:17.818131 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 470/914] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:17 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1556 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:17.834173 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-83b7a55d-98f6-4966-9919-11b02e8dcd12 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:17.834524 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-83b7a55d-98f6-4966-9919-11b02e8dcd12 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:17.840578 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-83b7a55d-98f6-4966-9919-11b02e8dcd12 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:17.841046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-83b7a55d-98f6-4966-9919-11b02e8dcd12 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:17.841846 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-83b7a55d-98f6-4966-9919-11b02e8dcd12 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:17.842272 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-83b7a55d-98f6-4966-9919-11b02e8dcd12 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:17.937209 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4dd463cf-f3e8-4b72-9258-4aac862ae7bc tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:17.942032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-83b7a55d-98f6-4966-9919-11b02e8dcd12 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111639 May 16 19:14:17.942730 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 471/915] 10.222.0.24 () {58 vars in 1274 bytes} [Mon May 16 19:14:17 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:14:17.951122 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4dd463cf-f3e8-4b72-9258-4aac862ae7bc tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1264 microversion: 2.1 time: 0.204188 May 16 19:14:17.956039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 445/916] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:17 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1264 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:14:18.709489 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e11d6eeb-8000-4e38-8b24-c2a09ed1f6f8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:18.710154 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e11d6eeb-8000-4e38-8b24-c2a09ed1f6f8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:18.716762 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e11d6eeb-8000-4e38-8b24-c2a09ed1f6f8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:18.717211 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e11d6eeb-8000-4e38-8b24-c2a09ed1f6f8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:18.718020 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e11d6eeb-8000-4e38-8b24-c2a09ed1f6f8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:18.718461 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e11d6eeb-8000-4e38-8b24-c2a09ed1f6f8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:18.848395 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e11d6eeb-8000-4e38-8b24-c2a09ed1f6f8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:18.857897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e11d6eeb-8000-4e38-8b24-c2a09ed1f6f8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:18.859378 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e11d6eeb-8000-4e38-8b24-c2a09ed1f6f8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:18.860577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e11d6eeb-8000-4e38-8b24-c2a09ed1f6f8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1724 microversion: 2.20 time: 0.155658 May 16 19:14:18.861355 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 472/917] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:18 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:18.873107 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-b504aa83-a6ae-4025-906e-6b99d2835a85 req-d0d05eab-cbc3-4653-ae8e-bd8623deb09a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0498aab-f458-4907-8557-c094918d4cdd", "tag": "ca17ae0a-1bb1-4979-a11b-bcee0aa3f50c"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:18.881700 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-b504aa83-a6ae-4025-906e-6b99d2835a85 req-d0d05eab-cbc3-4653-ae8e-bd8623deb09a service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:18.882143 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-b504aa83-a6ae-4025-906e-6b99d2835a85 req-d0d05eab-cbc3-4653-ae8e-bd8623deb09a service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:18.892790 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-b504aa83-a6ae-4025-906e-6b99d2835a85 req-d0d05eab-cbc3-4653-ae8e-bd8623deb09a service nova] Creating event network-changed:ca17ae0a-1bb1-4979-a11b-bcee0aa3f50c for instance a0498aab-f458-4907-8557-c094918d4cdd on hv-cinder-76606 May 16 19:14:18.898217 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-b504aa83-a6ae-4025-906e-6b99d2835a85 req-d0d05eab-cbc3-4653-ae8e-bd8623deb09a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028888 May 16 19:14:18.898849 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 446/918] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:18.966927 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4bd254fe-8094-4c8c-8a81-d5fb798ff9b8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:18.967540 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-4bd254fe-8094-4c8c-8a81-d5fb798ff9b8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:18.973855 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4bd254fe-8094-4c8c-8a81-d5fb798ff9b8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:18.974305 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4bd254fe-8094-4c8c-8a81-d5fb798ff9b8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:18.975108 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4bd254fe-8094-4c8c-8a81-d5fb798ff9b8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:18.975534 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4bd254fe-8094-4c8c-8a81-d5fb798ff9b8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:19.117340 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4bd254fe-8094-4c8c-8a81-d5fb798ff9b8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:19.125829 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4bd254fe-8094-4c8c-8a81-d5fb798ff9b8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1264 microversion: 2.1 time: 0.162726 May 16 19:14:19.126392 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 473/919] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:18 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:19.880103 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ff908bdf-8aa0-4ff2-83b8-d0f290c3abab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:19.880800 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ff908bdf-8aa0-4ff2-83b8-d0f290c3abab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:19.887792 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ff908bdf-8aa0-4ff2-83b8-d0f290c3abab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:19.888235 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ff908bdf-8aa0-4ff2-83b8-d0f290c3abab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:19.889029 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ff908bdf-8aa0-4ff2-83b8-d0f290c3abab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:19.889436 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ff908bdf-8aa0-4ff2-83b8-d0f290c3abab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:20.085750 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ff908bdf-8aa0-4ff2-83b8-d0f290c3abab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:20.094467 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ff908bdf-8aa0-4ff2-83b8-d0f290c3abab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:20.095944 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ff908bdf-8aa0-4ff2-83b8-d0f290c3abab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:20.097111 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ff908bdf-8aa0-4ff2-83b8-d0f290c3abab tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1724 microversion: 2.20 time: 0.221443 May 16 19:14:20.097906 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 447/920] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:19 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:20.142840 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c652831e-838c-4d98-86ec-3540970c12a7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:20.143455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c652831e-838c-4d98-86ec-3540970c12a7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:20.150491 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c652831e-838c-4d98-86ec-3540970c12a7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:20.150935 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c652831e-838c-4d98-86ec-3540970c12a7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:20.151716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c652831e-838c-4d98-86ec-3540970c12a7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:20.152145 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c652831e-838c-4d98-86ec-3540970c12a7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:20.290563 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c652831e-838c-4d98-86ec-3540970c12a7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:20.299674 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c652831e-838c-4d98-86ec-3540970c12a7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1452 microversion: 2.1 time: 0.160886 May 16 19:14:20.300242 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 474/921] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:20 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:20.316203 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9c0e0a5d-7a11-43a5-9976-1b9321b04102 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:20.316830 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9c0e0a5d-7a11-43a5-9976-1b9321b04102 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:20.322679 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-44710879-c799-4596-a078-410db44fabc3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:20.323166 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-44710879-c799-4596-a078-410db44fabc3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:20.323382 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9c0e0a5d-7a11-43a5-9976-1b9321b04102 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:20.323839 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9c0e0a5d-7a11-43a5-9976-1b9321b04102 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:20.324651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9c0e0a5d-7a11-43a5-9976-1b9321b04102 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:20.325087 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9c0e0a5d-7a11-43a5-9976-1b9321b04102 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:20.329169 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-44710879-c799-4596-a078-410db44fabc3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:20.329586 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-44710879-c799-4596-a078-410db44fabc3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:20.330335 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-44710879-c799-4596-a078-410db44fabc3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:20.330761 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-44710879-c799-4596-a078-410db44fabc3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:20.355107 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-44710879-c799-4596-a078-410db44fabc3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Going to try to terminate instance {{(pid=117274) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:14:20.437258 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-44710879-c799-4596-a078-410db44fabc3 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 204 len: 0 microversion: 2.1 time: 0.118148 May 16 19:14:20.438018 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 475/922] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:14:20 2022] DELETE /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 19:14:20.446638 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-3cabc57d-fa34-45cd-bce5-cded63930b10 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:20.447551 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-3cabc57d-fa34-45cd-bce5-cded63930b10 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:20.453470 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3cabc57d-fa34-45cd-bce5-cded63930b10 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:20.453947 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3cabc57d-fa34-45cd-bce5-cded63930b10 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:20.454716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3cabc57d-fa34-45cd-bce5-cded63930b10 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:20.455141 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3cabc57d-fa34-45cd-bce5-cded63930b10 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:20.467909 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-9c0e0a5d-7a11-43a5-9976-1b9321b04102 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:20.475671 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9c0e0a5d-7a11-43a5-9976-1b9321b04102 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1452 microversion: 2.1 time: 0.163529 May 16 19:14:20.476369 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 448/923] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:20 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:20.587365 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-3cabc57d-fa34-45cd-bce5-cded63930b10 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:20.595060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-3cabc57d-fa34-45cd-bce5-cded63930b10 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1507 microversion: 2.1 time: 0.152494 May 16 19:14:20.595699 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 476/924] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:20 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:21.115934 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-eb990e62-541a-4d05-ba72-c808c90a36ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:21.117224 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-eb990e62-541a-4d05-ba72-c808c90a36ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:21.126400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eb990e62-541a-4d05-ba72-c808c90a36ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:21.126847 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eb990e62-541a-4d05-ba72-c808c90a36ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:21.127618 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eb990e62-541a-4d05-ba72-c808c90a36ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:21.128040 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eb990e62-541a-4d05-ba72-c808c90a36ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:21.612782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ce5b3991-e083-44fe-ab60-66c528dc90c1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:21.613518 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ce5b3991-e083-44fe-ab60-66c528dc90c1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:21.617401 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-eb990e62-541a-4d05-ba72-c808c90a36ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:21.620170 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ce5b3991-e083-44fe-ab60-66c528dc90c1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:21.620647 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ce5b3991-e083-44fe-ab60-66c528dc90c1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:21.621496 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ce5b3991-e083-44fe-ab60-66c528dc90c1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:21.622060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ce5b3991-e083-44fe-ab60-66c528dc90c1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:21.625918 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-eb990e62-541a-4d05-ba72-c808c90a36ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:21.627432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-eb990e62-541a-4d05-ba72-c808c90a36ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:21.628624 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-eb990e62-541a-4d05-ba72-c808c90a36ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1724 microversion: 2.20 time: 0.517093 May 16 19:14:21.639439 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 449/925] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:21 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1724 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:21.757377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ce5b3991-e083-44fe-ab60-66c528dc90c1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:21.765187 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ce5b3991-e083-44fe-ab60-66c528dc90c1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1507 microversion: 2.1 time: 0.156654 May 16 19:14:21.765985 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 477/926] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:21 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:22.621467 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-b24d164a-47d2-4c68-809f-8de2c0d8f3e6 req-0c99aff0-b9ea-404d-9ded-b74f0b1c378a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6fa5413-e91f-461c-8007-e68d68254d4d", "name": "network-vif-deleted", "tag": "d42ccf63-2fe3-4b5d-ac16-147a92271cef"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:22.632513 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-b24d164a-47d2-4c68-809f-8de2c0d8f3e6 req-0c99aff0-b9ea-404d-9ded-b74f0b1c378a service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:22.633132 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-b24d164a-47d2-4c68-809f-8de2c0d8f3e6 req-0c99aff0-b9ea-404d-9ded-b74f0b1c378a service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:22.650088 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-bd58427f-a60c-48f1-a653-d63314afcd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:22.651175 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-bd58427f-a60c-48f1-a653-d63314afcd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:22.658474 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-b24d164a-47d2-4c68-809f-8de2c0d8f3e6 req-0c99aff0-b9ea-404d-9ded-b74f0b1c378a service nova] Creating event network-vif-deleted:d42ccf63-2fe3-4b5d-ac16-147a92271cef for instance e6fa5413-e91f-461c-8007-e68d68254d4d on hv-cinder-76606 May 16 19:14:22.659895 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd58427f-a60c-48f1-a653-d63314afcd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:22.660341 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd58427f-a60c-48f1-a653-d63314afcd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:22.661180 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd58427f-a60c-48f1-a653-d63314afcd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:22.661812 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd58427f-a60c-48f1-a653-d63314afcd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:22.664965 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-b24d164a-47d2-4c68-809f-8de2c0d8f3e6 req-0c99aff0-b9ea-404d-9ded-b74f0b1c378a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050114 May 16 19:14:22.666450 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 450/927] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:22.782902 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-cebb703b-a998-443b-af5c-2c23b1b2d9fe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:22.783933 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-cebb703b-a998-443b-af5c-2c23b1b2d9fe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:22.791914 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cebb703b-a998-443b-af5c-2c23b1b2d9fe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:22.792566 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cebb703b-a998-443b-af5c-2c23b1b2d9fe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:22.793690 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cebb703b-a998-443b-af5c-2c23b1b2d9fe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:22.794008 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cebb703b-a998-443b-af5c-2c23b1b2d9fe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:22.810451 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-bd58427f-a60c-48f1-a653-d63314afcd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:22.828520 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-bd58427f-a60c-48f1-a653-d63314afcd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:22.831082 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-bd58427f-a60c-48f1-a653-d63314afcd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:22.833549 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-bd58427f-a60c-48f1-a653-d63314afcd4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1724 microversion: 2.20 time: 0.190222 May 16 19:14:22.835114 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 478/928] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:22 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:22.836596 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cebb703b-a998-443b-af5c-2c23b1b2d9fe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:22.837108 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cebb703b-a998-443b-af5c-2c23b1b2d9fe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:22.837638 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.objects.instance [None req-cebb703b-a998-443b-af5c-2c23b1b2d9fe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lazy-loading 'fault' on Instance uuid e6fa5413-e91f-461c-8007-e68d68254d4d {{(pid=117275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:14:22.884465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-cebb703b-a998-443b-af5c-2c23b1b2d9fe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:22.895147 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-cebb703b-a998-443b-af5c-2c23b1b2d9fe tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 200 len: 1312 microversion: 2.1 time: 0.116365 May 16 19:14:22.895752 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 451/929] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:22 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:14:23.851797 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-38d18e23-4451-43cc-a213-8932d02866cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:23.852396 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-38d18e23-4451-43cc-a213-8932d02866cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:23.860763 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-38d18e23-4451-43cc-a213-8932d02866cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:23.861209 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-38d18e23-4451-43cc-a213-8932d02866cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:23.862027 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-38d18e23-4451-43cc-a213-8932d02866cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:23.862467 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-38d18e23-4451-43cc-a213-8932d02866cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:23.913109 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ef7ce995-7042-44af-92bf-dced7d1bd06b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:23.914398 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ef7ce995-7042-44af-92bf-dced7d1bd06b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: e6fa5413-e91f-461c-8007-e68d68254d4d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:23.922563 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ef7ce995-7042-44af-92bf-dced7d1bd06b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:23.923255 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ef7ce995-7042-44af-92bf-dced7d1bd06b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:23.924225 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ef7ce995-7042-44af-92bf-dced7d1bd06b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:23.924663 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ef7ce995-7042-44af-92bf-dced7d1bd06b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:23.939726 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-ef7ce995-7042-44af-92bf-dced7d1bd06b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] HTTP exception thrown: Instance e6fa5413-e91f-461c-8007-e68d68254d4d could not be found. May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ef7ce995-7042-44af-92bf-dced7d1bd06b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Request method failure captured: May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d HTTP/1.1 May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqEpTPlBWWpGAb8naoUtmT0kghhiI3kimMzn0_IWG3sCJkSvB5xO-7IGvOFSSINkqC-urNwmtwl2u96aKU3xl-Dex2fmV-bVO4ktBC40rbYPJQDH7eWDNSupKRIkwS3ds8fzriCvEWSDHbsHMvvS0L95hwszzciSeDbpHSrW4xtsOro May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: ba2c6e5fee5b402fa68833228d12c8e7 May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-949694738 May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:14:23.941437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:14:23.943324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:14:23.943324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-ServerRescueNegativeTestJSON-949694738 May 16 19:14:23.943324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: ba2c6e5fee5b402fa68833228d12c8e7 May 16 19:14:23.943324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-949694738 May 16 19:14:23.943324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-ServerRescueNegativeTestJSON-949694738-project May 16 19:14:23.943324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:14:23.943324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:14:23.943324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 1673e91c8910435499a5d587f4ef59f9 May 16 19:14:23.943324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-ServerRescueNegativeTestJSON-949694738-project May 16 19:14:23.943324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:14:23.943324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance e6fa5413-e91f-461c-8007-e68d68254d4d could not be found. May 16 19:14:23.943324 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': 'e6fa5413-e91f-461c-8007-e68d68254d4d'} May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6fa5413-e91f-461c-8007-e68d68254d4d could not be found. May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:14:23.944546 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6fa5413-e91f-461c-8007-e68d68254d4d could not be found. May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6fa5413-e91f-461c-8007-e68d68254d4d could not be found. May 16 19:14:23.946270 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:14:23.947638 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ef7ce995-7042-44af-92bf-dced7d1bd06b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Returning 404 to user: Instance e6fa5413-e91f-461c-8007-e68d68254d4d could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:14:23.947638 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ef7ce995-7042-44af-92bf-dced7d1bd06b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d" status: 404 len: 111 microversion: 2.1 time: 0.034459 May 16 19:14:23.947638 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 452/930] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:23 2022] GET /compute/v2.1/servers/e6fa5413-e91f-461c-8007-e68d68254d4d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:14:23.952057 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-63b74140-ccc7-4b34-8ca3-25f243eedacb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:23.952550 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-63b74140-ccc7-4b34-8ca3-25f243eedacb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:23.959015 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-63b74140-ccc7-4b34-8ca3-25f243eedacb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:23.959458 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-63b74140-ccc7-4b34-8ca3-25f243eedacb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:23.960219 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-63b74140-ccc7-4b34-8ca3-25f243eedacb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:23.960677 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-63b74140-ccc7-4b34-8ca3-25f243eedacb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:23.985732 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-63b74140-ccc7-4b34-8ca3-25f243eedacb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Going to try to terminate instance {{(pid=117275) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:14:23.998417 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-38d18e23-4451-43cc-a213-8932d02866cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:24.006421 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-38d18e23-4451-43cc-a213-8932d02866cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:24.007929 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-38d18e23-4451-43cc-a213-8932d02866cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:24.009139 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-38d18e23-4451-43cc-a213-8932d02866cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1724 microversion: 2.20 time: 0.161452 May 16 19:14:24.009713 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 479/931] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:23 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:24.063401 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-63b74140-ccc7-4b34-8ca3-25f243eedacb tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 204 len: 0 microversion: 2.1 time: 0.114870 May 16 19:14:24.063970 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 453/932] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:14:23 2022] DELETE /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 19:14:24.072434 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-fd9d2838-de9b-4777-b15f-66c6f9c5e26e tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:24.073053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-fd9d2838-de9b-4777-b15f-66c6f9c5e26e tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:24.079064 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fd9d2838-de9b-4777-b15f-66c6f9c5e26e tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:24.079511 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fd9d2838-de9b-4777-b15f-66c6f9c5e26e tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:24.080284 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fd9d2838-de9b-4777-b15f-66c6f9c5e26e tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:24.080725 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fd9d2838-de9b-4777-b15f-66c6f9c5e26e tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:24.216054 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-fd9d2838-de9b-4777-b15f-66c6f9c5e26e tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:24.231519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-fd9d2838-de9b-4777-b15f-66c6f9c5e26e tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.162826 May 16 19:14:24.232525 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 480/933] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:24 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:24.686870 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-2a1b4adf-7883-4373-93b7-c646dcb6fe6b req-2a54c6c4-ecb4-4df7-87f8-d16b7fb62d31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3e480e-c9ee-46ba-8393-c289b3fee9eb", "tag": "b4806342-52fb-4a7f-bc66-ac85ae8e8213"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:24.696414 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-2a1b4adf-7883-4373-93b7-c646dcb6fe6b req-2a54c6c4-ecb4-4df7-87f8-d16b7fb62d31 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:24.697011 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-2a1b4adf-7883-4373-93b7-c646dcb6fe6b req-2a54c6c4-ecb4-4df7-87f8-d16b7fb62d31 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:24.710407 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-2a1b4adf-7883-4373-93b7-c646dcb6fe6b req-2a54c6c4-ecb4-4df7-87f8-d16b7fb62d31 service nova] Creating event network-changed:b4806342-52fb-4a7f-bc66-ac85ae8e8213 for instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb on hv-cinder-76606 May 16 19:14:24.715879 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-2a1b4adf-7883-4373-93b7-c646dcb6fe6b req-2a54c6c4-ecb4-4df7-87f8-d16b7fb62d31 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033792 May 16 19:14:24.716654 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 454/934] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:25.032814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-28216e02-d7d8-4a7b-86d8-b33ffaf1f057 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:25.033781 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-28216e02-d7d8-4a7b-86d8-b33ffaf1f057 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:25.043172 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-28216e02-d7d8-4a7b-86d8-b33ffaf1f057 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:25.043630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-28216e02-d7d8-4a7b-86d8-b33ffaf1f057 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:25.044410 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-28216e02-d7d8-4a7b-86d8-b33ffaf1f057 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:25.044851 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-28216e02-d7d8-4a7b-86d8-b33ffaf1f057 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:25.181160 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-28216e02-d7d8-4a7b-86d8-b33ffaf1f057 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:25.189094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-28216e02-d7d8-4a7b-86d8-b33ffaf1f057 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:25.190623 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-28216e02-d7d8-4a7b-86d8-b33ffaf1f057 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:25.191805 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-28216e02-d7d8-4a7b-86d8-b33ffaf1f057 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1724 microversion: 2.20 time: 0.165842 May 16 19:14:25.192357 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 481/935] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:25 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:25.252432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e1a0b6fe-2919-4050-9295-e4d709b9774b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:25.253153 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e1a0b6fe-2919-4050-9295-e4d709b9774b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:25.261863 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e1a0b6fe-2919-4050-9295-e4d709b9774b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:25.262310 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e1a0b6fe-2919-4050-9295-e4d709b9774b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:25.263078 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e1a0b6fe-2919-4050-9295-e4d709b9774b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:25.263508 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e1a0b6fe-2919-4050-9295-e4d709b9774b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:25.413779 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e1a0b6fe-2919-4050-9295-e4d709b9774b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:25.421664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e1a0b6fe-2919-4050-9295-e4d709b9774b tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.176605 May 16 19:14:25.422241 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 455/936] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:25 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:26.210568 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-264e49d6-fbae-4185-b1f4-1a3e569980ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:26.211383 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-264e49d6-fbae-4185-b1f4-1a3e569980ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:26.218493 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-264e49d6-fbae-4185-b1f4-1a3e569980ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:26.218945 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-264e49d6-fbae-4185-b1f4-1a3e569980ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:26.219719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-264e49d6-fbae-4185-b1f4-1a3e569980ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:26.220125 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-264e49d6-fbae-4185-b1f4-1a3e569980ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:26.359408 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-264e49d6-fbae-4185-b1f4-1a3e569980ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:26.368396 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-264e49d6-fbae-4185-b1f4-1a3e569980ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:26.370256 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-264e49d6-fbae-4185-b1f4-1a3e569980ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:26.371476 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-264e49d6-fbae-4185-b1f4-1a3e569980ad tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1724 microversion: 2.20 time: 0.165548 May 16 19:14:26.379423 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 482/937] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:26 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:26.439543 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e2d362bf-3a50-4e16-87a3-e6a5ac68aed0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:26.440258 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e2d362bf-3a50-4e16-87a3-e6a5ac68aed0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:26.447219 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e2d362bf-3a50-4e16-87a3-e6a5ac68aed0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:26.447757 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e2d362bf-3a50-4e16-87a3-e6a5ac68aed0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:26.448594 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e2d362bf-3a50-4e16-87a3-e6a5ac68aed0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:26.449083 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e2d362bf-3a50-4e16-87a3-e6a5ac68aed0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:26.790932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e2d362bf-3a50-4e16-87a3-e6a5ac68aed0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673e91c8910435499a5d587f4ef59f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba2c6e5fee5b402fa68833228d12c8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:26.798965 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e2d362bf-3a50-4e16-87a3-e6a5ac68aed0 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 200 len: 1520 microversion: 2.1 time: 0.363287 May 16 19:14:26.799683 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 456/938] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:26 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 1520 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:27.256824 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-e0e854ea-52c9-430d-abfa-a3b2c9193e82 req-2a99daed-3a81-4877-b259-4a5453add414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc4667a-a2c3-459c-ac05-45720bc0f622", "name": "network-vif-deleted", "tag": "481f3e6e-6d8b-4a1e-96fe-1213734def9a"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:27.266683 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-e0e854ea-52c9-430d-abfa-a3b2c9193e82 req-2a99daed-3a81-4877-b259-4a5453add414 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:27.268311 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-e0e854ea-52c9-430d-abfa-a3b2c9193e82 req-2a99daed-3a81-4877-b259-4a5453add414 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:27.282244 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-e0e854ea-52c9-430d-abfa-a3b2c9193e82 req-2a99daed-3a81-4877-b259-4a5453add414 service nova] Creating event network-vif-deleted:481f3e6e-6d8b-4a1e-96fe-1213734def9a for instance 9cc4667a-a2c3-459c-ac05-45720bc0f622 on hv-cinder-76606 May 16 19:14:27.288843 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-e0e854ea-52c9-430d-abfa-a3b2c9193e82 req-2a99daed-3a81-4877-b259-4a5453add414 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035438 May 16 19:14:27.289469 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 483/939] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:27.390834 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-bd2e7782-5f7e-4f24-9be5-4ee03932ce6b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:27.391539 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-bd2e7782-5f7e-4f24-9be5-4ee03932ce6b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:27.398576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bd2e7782-5f7e-4f24-9be5-4ee03932ce6b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:27.399080 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bd2e7782-5f7e-4f24-9be5-4ee03932ce6b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:27.399905 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bd2e7782-5f7e-4f24-9be5-4ee03932ce6b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:27.400351 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-bd2e7782-5f7e-4f24-9be5-4ee03932ce6b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:27.537327 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-bd2e7782-5f7e-4f24-9be5-4ee03932ce6b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:27.547207 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-bd2e7782-5f7e-4f24-9be5-4ee03932ce6b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:27.548725 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-bd2e7782-5f7e-4f24-9be5-4ee03932ce6b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:27.550058 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-bd2e7782-5f7e-4f24-9be5-4ee03932ce6b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1745 microversion: 2.20 time: 0.163546 May 16 19:14:27.550951 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 457/940] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:27 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:27.643208 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c160809f-ef53-4699-9913-71bfe68dcf3b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:27.644462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c160809f-ef53-4699-9913-71bfe68dcf3b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:27.652132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c160809f-ef53-4699-9913-71bfe68dcf3b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:27.652587 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c160809f-ef53-4699-9913-71bfe68dcf3b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:27.653377 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c160809f-ef53-4699-9913-71bfe68dcf3b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:27.653850 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c160809f-ef53-4699-9913-71bfe68dcf3b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:27.678260 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c160809f-ef53-4699-9913-71bfe68dcf3b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/ips" status: 200 len: 144 microversion: 2.1 time: 0.039760 May 16 19:14:27.678994 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 484/941] 10.222.0.24 () {58 vars in 1247 bytes} [Mon May 16 19:14:27 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/ips => generated 144 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:27.816894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-64a540ea-88b1-4843-a5b3-fcea2a2dd7d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:27.817633 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-64a540ea-88b1-4843-a5b3-fcea2a2dd7d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] [instance: 9cc4667a-a2c3-459c-ac05-45720bc0f622] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:27.825712 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-64a540ea-88b1-4843-a5b3-fcea2a2dd7d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:27.826376 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-64a540ea-88b1-4843-a5b3-fcea2a2dd7d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:27.827608 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-64a540ea-88b1-4843-a5b3-fcea2a2dd7d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:27.828208 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-64a540ea-88b1-4843-a5b3-fcea2a2dd7d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:27.842930 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-64a540ea-88b1-4843-a5b3-fcea2a2dd7d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] HTTP exception thrown: Instance 9cc4667a-a2c3-459c-ac05-45720bc0f622 could not be found. May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-64a540ea-88b1-4843-a5b3-fcea2a2dd7d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Request method failure captured: May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 HTTP/1.1 May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqEpTPlBWWpGAb8naoUtmT0kghhiI3kimMzn0_IWG3sCJkSvB5xO-7IGvOFSSINkqC-urNwmtwl2u96aKU3xl-Dex2fmV-bVO4ktBC40rbYPJQDH7eWDNSupKRIkwS3ds8fzriCvEWSDHbsHMvvS0L95hwszzciSeDbpHSrW4xtsOro May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: ba2c6e5fee5b402fa68833228d12c8e7 May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-949694738 May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:14:27.844791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:14:27.846400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ba2c6e5fee5b402fa68833228d12c8e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:14:27.846400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-ServerRescueNegativeTestJSON-949694738 May 16 19:14:27.846400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: ba2c6e5fee5b402fa68833228d12c8e7 May 16 19:14:27.846400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-949694738 May 16 19:14:27.846400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-ServerRescueNegativeTestJSON-949694738-project May 16 19:14:27.846400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:14:27.846400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:14:27.846400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 1673e91c8910435499a5d587f4ef59f9 May 16 19:14:27.846400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-ServerRescueNegativeTestJSON-949694738-project May 16 19:14:27.846400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:14:27.846400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance 9cc4667a-a2c3-459c-ac05-45720bc0f622 could not be found. May 16 19:14:27.846400 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': '9cc4667a-a2c3-459c-ac05-45720bc0f622'} May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc4667a-a2c3-459c-ac05-45720bc0f622 could not be found. May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:14:27.847350 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc4667a-a2c3-459c-ac05-45720bc0f622 could not be found. May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc4667a-a2c3-459c-ac05-45720bc0f622 could not be found. May 16 19:14:27.849027 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:14:27.850943 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-64a540ea-88b1-4843-a5b3-fcea2a2dd7d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] Returning 404 to user: Instance 9cc4667a-a2c3-459c-ac05-45720bc0f622 could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:14:27.850943 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-64a540ea-88b1-4843-a5b3-fcea2a2dd7d1 tempest-ServerRescueNegativeTestJSON-949694738 tempest-ServerRescueNegativeTestJSON-949694738-project] 10.222.0.24 "GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622" status: 404 len: 111 microversion: 2.1 time: 0.036656 May 16 19:14:27.857746 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 458/942] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:27 2022] GET /compute/v2.1/servers/9cc4667a-a2c3-459c-ac05-45720bc0f622 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:14:28.083500 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8eeed105-6bfa-4c0a-9b3c-75304c707ca9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:28.084062 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8eeed105-6bfa-4c0a-9b3c-75304c707ca9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:28.090347 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8eeed105-6bfa-4c0a-9b3c-75304c707ca9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:28.090795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8eeed105-6bfa-4c0a-9b3c-75304c707ca9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:28.091585 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8eeed105-6bfa-4c0a-9b3c-75304c707ca9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:28.092019 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8eeed105-6bfa-4c0a-9b3c-75304c707ca9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:28.116231 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-8eeed105-6bfa-4c0a-9b3c-75304c707ca9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lazy-loading 'flavor' on Instance uuid 96a385b0-58f3-4946-b6c6-2cbd20fe387f {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:14:28.196286 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8eeed105-6bfa-4c0a-9b3c-75304c707ca9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "POST /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f/action" status: 202 len: 0 microversion: 2.1 time: 0.116652 May 16 19:14:28.196915 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 485/943] 10.222.0.24 () {60 vars in 1277 bytes} [Mon May 16 19:14:28 2022] POST /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:14:28.206370 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b4c7dde5-b78c-4f27-b58e-7fadac0128d2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:28.207111 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b4c7dde5-b78c-4f27-b58e-7fadac0128d2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:28.214433 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b4c7dde5-b78c-4f27-b58e-7fadac0128d2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:28.215032 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b4c7dde5-b78c-4f27-b58e-7fadac0128d2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:28.215964 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b4c7dde5-b78c-4f27-b58e-7fadac0128d2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:28.216432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b4c7dde5-b78c-4f27-b58e-7fadac0128d2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:28.462662 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b4c7dde5-b78c-4f27-b58e-7fadac0128d2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:28.470275 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b4c7dde5-b78c-4f27-b58e-7fadac0128d2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.268529 May 16 19:14:28.470814 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 459/944] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:28 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:28.569805 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-71565ea6-0847-4f73-a776-d35bb9693f53 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:28.570482 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-71565ea6-0847-4f73-a776-d35bb9693f53 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:28.577513 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-71565ea6-0847-4f73-a776-d35bb9693f53 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:28.577985 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-71565ea6-0847-4f73-a776-d35bb9693f53 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:28.578770 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-71565ea6-0847-4f73-a776-d35bb9693f53 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:28.579201 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-71565ea6-0847-4f73-a776-d35bb9693f53 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:28.718151 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-71565ea6-0847-4f73-a776-d35bb9693f53 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:28.726488 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-71565ea6-0847-4f73-a776-d35bb9693f53 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:28.728094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-71565ea6-0847-4f73-a776-d35bb9693f53 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:28.729289 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-71565ea6-0847-4f73-a776-d35bb9693f53 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1745 microversion: 2.20 time: 0.164407 May 16 19:14:28.729906 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 486/945] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:28 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:29.024570 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-32a8d974-152d-4ac9-b0ad-0281e0a5cdbe tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2eb8e12d-bbd7-42ea-baf5-687358063d81"}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:29.026466 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-32a8d974-152d-4ac9-b0ad-0281e0a5cdbe tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:29.032627 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-32a8d974-152d-4ac9-b0ad-0281e0a5cdbe tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:29.033063 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-32a8d974-152d-4ac9-b0ad-0281e0a5cdbe tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:29.033888 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-32a8d974-152d-4ac9-b0ad-0281e0a5cdbe tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:29.034297 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-32a8d974-152d-4ac9-b0ad-0281e0a5cdbe tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:29.350013 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-32a8d974-152d-4ac9-b0ad-0281e0a5cdbe tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "POST /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329080 May 16 19:14:29.352119 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 460/946] 10.222.0.24 () {60 vars in 1322 bytes} [Mon May 16 19:14:29 2022] POST /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:29.490116 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b61cbc7c-e314-45c7-b6fa-5f45fc5ca15a tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:29.496543 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b61cbc7c-e314-45c7-b6fa-5f45fc5ca15a tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:29.510175 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b61cbc7c-e314-45c7-b6fa-5f45fc5ca15a tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:29.511333 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b61cbc7c-e314-45c7-b6fa-5f45fc5ca15a tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:29.513160 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b61cbc7c-e314-45c7-b6fa-5f45fc5ca15a tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:29.514125 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b61cbc7c-e314-45c7-b6fa-5f45fc5ca15a tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:29.684689 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-e0437363-74d9-49ca-8b2f-78f4753ed30f req-6fa97960-38a0-4840-80ef-51d0b96d477a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b664a08c-f97e-4c52-b849-9eddb2e65be5", "name": "network-vif-plugged", "status": "completed", "tag": "34940ecb-c2a4-45ca-ad50-7ea9f112b22a"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:29.698809 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-e0437363-74d9-49ca-8b2f-78f4753ed30f req-6fa97960-38a0-4840-80ef-51d0b96d477a service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:29.699490 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-e0437363-74d9-49ca-8b2f-78f4753ed30f req-6fa97960-38a0-4840-80ef-51d0b96d477a service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:29.717726 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-e0437363-74d9-49ca-8b2f-78f4753ed30f req-6fa97960-38a0-4840-80ef-51d0b96d477a service nova] Creating event network-vif-plugged:34940ecb-c2a4-45ca-ad50-7ea9f112b22a for instance b664a08c-f97e-4c52-b849-9eddb2e65be5 on hv-cinder-76606 May 16 19:14:29.720649 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b61cbc7c-e314-45c7-b6fa-5f45fc5ca15a tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:29.724595 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-e0437363-74d9-49ca-8b2f-78f4753ed30f req-6fa97960-38a0-4840-80ef-51d0b96d477a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044587 May 16 19:14:29.726327 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 461/947] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:29.728366 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b61cbc7c-e314-45c7-b6fa-5f45fc5ca15a tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.244384 May 16 19:14:29.728939 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 487/948] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:29 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:14:29.752629 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5d11d20b-e05e-4f6c-a452-e9350ec67959 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:29.753396 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5d11d20b-e05e-4f6c-a452-e9350ec67959 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:29.761758 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d11d20b-e05e-4f6c-a452-e9350ec67959 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:29.762445 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d11d20b-e05e-4f6c-a452-e9350ec67959 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:29.763605 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d11d20b-e05e-4f6c-a452-e9350ec67959 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:29.764314 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d11d20b-e05e-4f6c-a452-e9350ec67959 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:30.035130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5d11d20b-e05e-4f6c-a452-e9350ec67959 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:30.047034 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5d11d20b-e05e-4f6c-a452-e9350ec67959 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:30.049578 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5d11d20b-e05e-4f6c-a452-e9350ec67959 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:30.051225 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5d11d20b-e05e-4f6c-a452-e9350ec67959 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1740 microversion: 2.20 time: 0.303886 May 16 19:14:30.052572 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 462/949] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:29 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1740 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:30.746147 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-6bc6c47d-0e6b-4cee-a3c1-a269ad407abc tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:30.747515 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-6bc6c47d-0e6b-4cee-a3c1-a269ad407abc tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:30.755530 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6bc6c47d-0e6b-4cee-a3c1-a269ad407abc tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:30.756766 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6bc6c47d-0e6b-4cee-a3c1-a269ad407abc tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:30.757873 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6bc6c47d-0e6b-4cee-a3c1-a269ad407abc tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:30.758831 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6bc6c47d-0e6b-4cee-a3c1-a269ad407abc tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:31.014279 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-6bc6c47d-0e6b-4cee-a3c1-a269ad407abc tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:31.022907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-6bc6c47d-0e6b-4cee-a3c1-a269ad407abc tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.281494 May 16 19:14:31.033101 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 488/950] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:30 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:31.071530 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0dd3c974-f7cd-459f-9ce1-7ee603767066 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:31.072156 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0dd3c974-f7cd-459f-9ce1-7ee603767066 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:31.089500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0dd3c974-f7cd-459f-9ce1-7ee603767066 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:31.090026 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0dd3c974-f7cd-459f-9ce1-7ee603767066 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:31.090871 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0dd3c974-f7cd-459f-9ce1-7ee603767066 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:31.092677 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0dd3c974-f7cd-459f-9ce1-7ee603767066 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:31.264708 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0dd3c974-f7cd-459f-9ce1-7ee603767066 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:31.282021 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0dd3c974-f7cd-459f-9ce1-7ee603767066 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:31.287843 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0dd3c974-f7cd-459f-9ce1-7ee603767066 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:31.289562 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0dd3c974-f7cd-459f-9ce1-7ee603767066 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1740 microversion: 2.20 time: 0.222977 May 16 19:14:31.290933 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 463/951] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:31 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:32.041295 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-49a267a4-568a-4a09-a828-f42081ad4b20 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:32.042406 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-49a267a4-568a-4a09-a828-f42081ad4b20 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:32.049713 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-49a267a4-568a-4a09-a828-f42081ad4b20 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:32.050487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-49a267a4-568a-4a09-a828-f42081ad4b20 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:32.051529 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-49a267a4-568a-4a09-a828-f42081ad4b20 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:32.052397 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-49a267a4-568a-4a09-a828-f42081ad4b20 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:32.316673 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1904e547-1c70-49a8-b386-29735d88d050 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:32.317295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1904e547-1c70-49a8-b386-29735d88d050 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:32.324777 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1904e547-1c70-49a8-b386-29735d88d050 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:32.325222 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1904e547-1c70-49a8-b386-29735d88d050 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:32.326043 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1904e547-1c70-49a8-b386-29735d88d050 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:32.326472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1904e547-1c70-49a8-b386-29735d88d050 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:32.344860 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-49a267a4-568a-4a09-a828-f42081ad4b20 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:32.359716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-49a267a4-568a-4a09-a828-f42081ad4b20 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.323079 May 16 19:14:32.374497 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 489/952] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:32 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:32.552641 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1904e547-1c70-49a8-b386-29735d88d050 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:32.562052 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1904e547-1c70-49a8-b386-29735d88d050 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:32.564662 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1904e547-1c70-49a8-b386-29735d88d050 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:32.566299 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1904e547-1c70-49a8-b386-29735d88d050 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1740 microversion: 2.20 time: 0.258467 May 16 19:14:32.578122 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 464/953] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:32 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:33.383515 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a171ce55-08c2-4c14-968d-e9b5d4c346e8 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:33.385351 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a171ce55-08c2-4c14-968d-e9b5d4c346e8 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:33.394215 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a171ce55-08c2-4c14-968d-e9b5d4c346e8 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:33.394971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a171ce55-08c2-4c14-968d-e9b5d4c346e8 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:33.395990 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a171ce55-08c2-4c14-968d-e9b5d4c346e8 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:33.396784 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a171ce55-08c2-4c14-968d-e9b5d4c346e8 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:33.583633 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a171ce55-08c2-4c14-968d-e9b5d4c346e8 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:33.584298 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5d5076de-ef8e-4565-8a9b-2f5133a02508 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:33.585914 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5d5076de-ef8e-4565-8a9b-2f5133a02508 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:33.593893 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d5076de-ef8e-4565-8a9b-2f5133a02508 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:33.594070 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a171ce55-08c2-4c14-968d-e9b5d4c346e8 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.216088 May 16 19:14:33.594690 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d5076de-ef8e-4565-8a9b-2f5133a02508 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:33.595854 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d5076de-ef8e-4565-8a9b-2f5133a02508 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:33.596625 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 490/954] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:33 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:33.597313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d5076de-ef8e-4565-8a9b-2f5133a02508 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:33.781356 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5d5076de-ef8e-4565-8a9b-2f5133a02508 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:33.790092 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5d5076de-ef8e-4565-8a9b-2f5133a02508 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:33.792961 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5d5076de-ef8e-4565-8a9b-2f5133a02508 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:33.794636 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5d5076de-ef8e-4565-8a9b-2f5133a02508 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1740 microversion: 2.20 time: 0.214298 May 16 19:14:33.795764 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 465/955] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:33 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:14:34.613011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ed356d4d-acd6-4cf1-bd30-1e85c0a9fc8b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:34.614593 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ed356d4d-acd6-4cf1-bd30-1e85c0a9fc8b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:34.623325 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ed356d4d-acd6-4cf1-bd30-1e85c0a9fc8b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:34.627088 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ed356d4d-acd6-4cf1-bd30-1e85c0a9fc8b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:34.635792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ed356d4d-acd6-4cf1-bd30-1e85c0a9fc8b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:34.637206 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ed356d4d-acd6-4cf1-bd30-1e85c0a9fc8b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:34.812221 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-24d7f309-ad34-4b23-8328-953bd732b215 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:34.812826 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-24d7f309-ad34-4b23-8328-953bd732b215 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:34.823082 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ed356d4d-acd6-4cf1-bd30-1e85c0a9fc8b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:34.827669 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-24d7f309-ad34-4b23-8328-953bd732b215 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:34.832443 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-24d7f309-ad34-4b23-8328-953bd732b215 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:34.833517 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-24d7f309-ad34-4b23-8328-953bd732b215 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:34.834425 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ed356d4d-acd6-4cf1-bd30-1e85c0a9fc8b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.225664 May 16 19:14:34.844932 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-24d7f309-ad34-4b23-8328-953bd732b215 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:34.845375 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 491/956] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:34 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:35.020530 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-24d7f309-ad34-4b23-8328-953bd732b215 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:35.028996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-24d7f309-ad34-4b23-8328-953bd732b215 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:35.030843 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-24d7f309-ad34-4b23-8328-953bd732b215 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:35.032612 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-24d7f309-ad34-4b23-8328-953bd732b215 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1740 microversion: 2.20 time: 0.224298 May 16 19:14:35.037584 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 466/957] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:34 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:35.852190 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-cfb9fa22-7566-4243-b824-879635059b48 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:35.852772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-cfb9fa22-7566-4243-b824-879635059b48 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:35.859472 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cfb9fa22-7566-4243-b824-879635059b48 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:35.859920 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cfb9fa22-7566-4243-b824-879635059b48 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:35.860770 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cfb9fa22-7566-4243-b824-879635059b48 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:35.861634 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cfb9fa22-7566-4243-b824-879635059b48 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:36.054684 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8cb20880-41a9-4531-aa5a-f70454cd867e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:36.055307 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8cb20880-41a9-4531-aa5a-f70454cd867e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:36.067332 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-cfb9fa22-7566-4243-b824-879635059b48 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:36.068012 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8cb20880-41a9-4531-aa5a-f70454cd867e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:36.068619 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8cb20880-41a9-4531-aa5a-f70454cd867e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:36.070320 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8cb20880-41a9-4531-aa5a-f70454cd867e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:36.071544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8cb20880-41a9-4531-aa5a-f70454cd867e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:36.076055 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-cfb9fa22-7566-4243-b824-879635059b48 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.226928 May 16 19:14:36.085831 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 492/958] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:35 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:36.252576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8cb20880-41a9-4531-aa5a-f70454cd867e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:36.262369 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8cb20880-41a9-4531-aa5a-f70454cd867e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:36.264255 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-8cb20880-41a9-4531-aa5a-f70454cd867e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:36.265852 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8cb20880-41a9-4531-aa5a-f70454cd867e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1740 microversion: 2.20 time: 0.218604 May 16 19:14:36.267007 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 467/959] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:36 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:14:37.081837 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7eae99f2-d26f-497d-8e33-a17c43a178d7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:37.082839 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7eae99f2-d26f-497d-8e33-a17c43a178d7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:37.089306 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7eae99f2-d26f-497d-8e33-a17c43a178d7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:37.089782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7eae99f2-d26f-497d-8e33-a17c43a178d7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:37.091169 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7eae99f2-d26f-497d-8e33-a17c43a178d7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:37.091782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7eae99f2-d26f-497d-8e33-a17c43a178d7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:37.093726 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0c75225b-0d48-4e4b-b4b6-cb7b065d25d9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:37.094557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0c75225b-0d48-4e4b-b4b6-cb7b065d25d9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:37.101934 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0c75225b-0d48-4e4b-b4b6-cb7b065d25d9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:37.102796 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0c75225b-0d48-4e4b-b4b6-cb7b065d25d9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:37.103847 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0c75225b-0d48-4e4b-b4b6-cb7b065d25d9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:37.104650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-0c75225b-0d48-4e4b-b4b6-cb7b065d25d9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:37.125445 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7eae99f2-d26f-497d-8e33-a17c43a178d7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047575 May 16 19:14:37.131669 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 493/960] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:14:37 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:37.136914 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5bfb516d-82b6-4109-b263-c00d8dfb76fe tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:37.137665 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5bfb516d-82b6-4109-b263-c00d8dfb76fe tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:37.144644 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5bfb516d-82b6-4109-b263-c00d8dfb76fe tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:37.145290 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5bfb516d-82b6-4109-b263-c00d8dfb76fe tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:37.146329 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5bfb516d-82b6-4109-b263-c00d8dfb76fe tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:37.147044 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5bfb516d-82b6-4109-b263-c00d8dfb76fe tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:37.184454 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-5bfb516d-82b6-4109-b263-c00d8dfb76fe tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments/2eb8e12d-bbd7-42ea-baf5-687358063d81" status: 200 len: 194 microversion: 2.1 time: 0.051389 May 16 19:14:37.185824 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 494/961] 10.222.0.24 () {58 vars in 1412 bytes} [Mon May 16 19:14:37 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments/2eb8e12d-bbd7-42ea-baf5-687358063d81 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:37.279057 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0c75225b-0d48-4e4b-b4b6-cb7b065d25d9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:37.289506 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0c75225b-0d48-4e4b-b4b6-cb7b065d25d9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.200180 May 16 19:14:37.290671 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-eb6af3c6-96f1-4b53-9494-6711a0b0bd38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:37.290818 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 468/962] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:37 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:37.291701 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-eb6af3c6-96f1-4b53-9494-6711a0b0bd38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:37.299689 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-eb6af3c6-96f1-4b53-9494-6711a0b0bd38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:37.300434 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-eb6af3c6-96f1-4b53-9494-6711a0b0bd38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:37.301487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-eb6af3c6-96f1-4b53-9494-6711a0b0bd38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:37.302175 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-eb6af3c6-96f1-4b53-9494-6711a0b0bd38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:37.494404 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-eb6af3c6-96f1-4b53-9494-6711a0b0bd38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:37.502942 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-eb6af3c6-96f1-4b53-9494-6711a0b0bd38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:37.504431 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-eb6af3c6-96f1-4b53-9494-6711a0b0bd38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:37.508787 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-eb6af3c6-96f1-4b53-9494-6711a0b0bd38 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1740 microversion: 2.20 time: 0.227692 May 16 19:14:37.509546 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 495/963] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:37 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:38.307163 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9e128e59-1093-4fff-aa74-aa65433c747b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:38.307917 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9e128e59-1093-4fff-aa74-aa65433c747b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:38.314433 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9e128e59-1093-4fff-aa74-aa65433c747b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:38.315101 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9e128e59-1093-4fff-aa74-aa65433c747b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:38.316217 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9e128e59-1093-4fff-aa74-aa65433c747b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:38.316649 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9e128e59-1093-4fff-aa74-aa65433c747b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:38.465385 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-9e128e59-1093-4fff-aa74-aa65433c747b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:38.473849 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9e128e59-1093-4fff-aa74-aa65433c747b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.170596 May 16 19:14:38.475024 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 469/964] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:38 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:38.530087 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e37a0fae-3bd0-4812-91d3-7be3f4b35419 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:38.530727 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e37a0fae-3bd0-4812-91d3-7be3f4b35419 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:38.537179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e37a0fae-3bd0-4812-91d3-7be3f4b35419 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:38.537632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e37a0fae-3bd0-4812-91d3-7be3f4b35419 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:38.538945 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e37a0fae-3bd0-4812-91d3-7be3f4b35419 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:38.540491 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e37a0fae-3bd0-4812-91d3-7be3f4b35419 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:38.639820 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5b4b79fd-9797-407c-8d45-0167978273e9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b55d46df-7f82-480d-a3aa-eff098da1e0d"}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:38.640986 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5b4b79fd-9797-407c-8d45-0167978273e9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:38.648202 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5b4b79fd-9797-407c-8d45-0167978273e9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:38.648678 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5b4b79fd-9797-407c-8d45-0167978273e9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:38.649467 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5b4b79fd-9797-407c-8d45-0167978273e9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:38.649924 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5b4b79fd-9797-407c-8d45-0167978273e9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:38.703699 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e37a0fae-3bd0-4812-91d3-7be3f4b35419 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:38.717134 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e37a0fae-3bd0-4812-91d3-7be3f4b35419 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:38.718914 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e37a0fae-3bd0-4812-91d3-7be3f4b35419 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:38.720439 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e37a0fae-3bd0-4812-91d3-7be3f4b35419 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1740 microversion: 2.20 time: 0.194396 May 16 19:14:38.721161 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 496/965] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:38 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:39.492604 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a2371ad2-bb2f-4a17-9ec6-037a6bdce9fa tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:39.493273 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a2371ad2-bb2f-4a17-9ec6-037a6bdce9fa tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:39.499701 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a2371ad2-bb2f-4a17-9ec6-037a6bdce9fa tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:39.500152 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a2371ad2-bb2f-4a17-9ec6-037a6bdce9fa tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:39.500954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a2371ad2-bb2f-4a17-9ec6-037a6bdce9fa tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:39.501394 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a2371ad2-bb2f-4a17-9ec6-037a6bdce9fa tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:39.649310 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a2371ad2-bb2f-4a17-9ec6-037a6bdce9fa tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:39.656864 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a2371ad2-bb2f-4a17-9ec6-037a6bdce9fa tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.168220 May 16 19:14:39.657382 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 497/966] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:39 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:14:39.738672 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d82c1bbd-0443-4653-89e6-e96d2201af4c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:39.739287 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d82c1bbd-0443-4653-89e6-e96d2201af4c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:39.746321 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d82c1bbd-0443-4653-89e6-e96d2201af4c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:39.746767 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d82c1bbd-0443-4653-89e6-e96d2201af4c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:39.747548 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d82c1bbd-0443-4653-89e6-e96d2201af4c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:39.747984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d82c1bbd-0443-4653-89e6-e96d2201af4c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:39.884520 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d82c1bbd-0443-4653-89e6-e96d2201af4c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:39.892870 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d82c1bbd-0443-4653-89e6-e96d2201af4c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:39.894808 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d82c1bbd-0443-4653-89e6-e96d2201af4c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:39.895977 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d82c1bbd-0443-4653-89e6-e96d2201af4c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1740 microversion: 2.20 time: 0.161308 May 16 19:14:39.896590 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 498/967] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:39 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:40.680524 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8c68ae3b-d8a3-4a2c-990b-0ff3b3f4cff4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:40.681597 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8c68ae3b-d8a3-4a2c-990b-0ff3b3f4cff4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:40.692229 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c68ae3b-d8a3-4a2c-990b-0ff3b3f4cff4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:40.692966 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c68ae3b-d8a3-4a2c-990b-0ff3b3f4cff4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:40.694310 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c68ae3b-d8a3-4a2c-990b-0ff3b3f4cff4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:40.695023 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c68ae3b-d8a3-4a2c-990b-0ff3b3f4cff4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:40.835766 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-8c68ae3b-d8a3-4a2c-990b-0ff3b3f4cff4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:40.843494 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8c68ae3b-d8a3-4a2c-990b-0ff3b3f4cff4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.170308 May 16 19:14:40.844047 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 499/968] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:40 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:40.916813 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-bf7bf9f3-8347-442e-9518-333cfc19a1c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:40.917418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-bf7bf9f3-8347-442e-9518-333cfc19a1c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:40.923481 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bf7bf9f3-8347-442e-9518-333cfc19a1c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:40.923955 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bf7bf9f3-8347-442e-9518-333cfc19a1c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:40.924719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bf7bf9f3-8347-442e-9518-333cfc19a1c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:40.925145 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bf7bf9f3-8347-442e-9518-333cfc19a1c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:41.061319 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-bf7bf9f3-8347-442e-9518-333cfc19a1c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:41.071235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-bf7bf9f3-8347-442e-9518-333cfc19a1c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:41.072721 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-bf7bf9f3-8347-442e-9518-333cfc19a1c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:41.073974 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-bf7bf9f3-8347-442e-9518-333cfc19a1c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1740 microversion: 2.20 time: 0.162593 May 16 19:14:41.074516 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 500/969] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:40 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:41.195668 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5b4b79fd-9797-407c-8d45-0167978273e9 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "POST /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.559562 May 16 19:14:41.196345 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 470/970] 10.222.0.24 () {60 vars in 1322 bytes} [Mon May 16 19:14:38 2022] POST /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments => generated 194 bytes in 2562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:14:41.861042 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8ca3c52a-4083-479b-8c04-e06c34836092 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:41.861693 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8ca3c52a-4083-479b-8c04-e06c34836092 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:41.869903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8ca3c52a-4083-479b-8c04-e06c34836092 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:41.870592 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8ca3c52a-4083-479b-8c04-e06c34836092 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:41.872049 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8ca3c52a-4083-479b-8c04-e06c34836092 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:41.872488 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8ca3c52a-4083-479b-8c04-e06c34836092 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:42.014718 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-8ca3c52a-4083-479b-8c04-e06c34836092 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:42.025273 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8ca3c52a-4083-479b-8c04-e06c34836092 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.168107 May 16 19:14:42.025936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 501/971] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:41 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:42.094741 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e93059df-afc2-414f-b3a5-c38ec09353b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:42.095319 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e93059df-afc2-414f-b3a5-c38ec09353b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:42.103212 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e93059df-afc2-414f-b3a5-c38ec09353b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:42.103855 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e93059df-afc2-414f-b3a5-c38ec09353b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:42.104830 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e93059df-afc2-414f-b3a5-c38ec09353b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:42.105485 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e93059df-afc2-414f-b3a5-c38ec09353b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:42.249843 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e93059df-afc2-414f-b3a5-c38ec09353b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:42.259851 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e93059df-afc2-414f-b3a5-c38ec09353b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:42.261505 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e93059df-afc2-414f-b3a5-c38ec09353b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:42.262927 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e93059df-afc2-414f-b3a5-c38ec09353b0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1722 microversion: 2.20 time: 0.173508 May 16 19:14:42.263425 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 471/972] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:42 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:43.042994 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8e2070d8-eaa0-45ee-b6ff-d6d730b90ed4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:43.046671 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8e2070d8-eaa0-45ee-b6ff-d6d730b90ed4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:43.052602 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8e2070d8-eaa0-45ee-b6ff-d6d730b90ed4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:43.053103 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8e2070d8-eaa0-45ee-b6ff-d6d730b90ed4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:43.053863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8e2070d8-eaa0-45ee-b6ff-d6d730b90ed4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:43.054303 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8e2070d8-eaa0-45ee-b6ff-d6d730b90ed4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:43.189148 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-8e2070d8-eaa0-45ee-b6ff-d6d730b90ed4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:43.196722 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8e2070d8-eaa0-45ee-b6ff-d6d730b90ed4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.157624 May 16 19:14:43.197258 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 502/973] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:43 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:43.282448 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-25502fbb-e57d-4489-bf82-5fcc1448a4e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:43.283038 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-25502fbb-e57d-4489-bf82-5fcc1448a4e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:43.290056 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-25502fbb-e57d-4489-bf82-5fcc1448a4e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:43.290535 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-25502fbb-e57d-4489-bf82-5fcc1448a4e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:43.291354 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-25502fbb-e57d-4489-bf82-5fcc1448a4e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:43.291786 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-25502fbb-e57d-4489-bf82-5fcc1448a4e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:43.423976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-25502fbb-e57d-4489-bf82-5fcc1448a4e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:43.431947 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-25502fbb-e57d-4489-bf82-5fcc1448a4e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:43.433459 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-25502fbb-e57d-4489-bf82-5fcc1448a4e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:43.434726 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-25502fbb-e57d-4489-bf82-5fcc1448a4e8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1722 microversion: 2.20 time: 0.156360 May 16 19:14:43.435300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 472/974] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:43 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:43.581717 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-bd4a5981-329f-49fe-aa11-03f2800aee6d req-b663d5c0-0807-4319-a2c3-afb832a046f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b664a08c-f97e-4c52-b849-9eddb2e65be5", "name": "network-vif-unplugged", "status": "completed", "tag": "34940ecb-c2a4-45ca-ad50-7ea9f112b22a"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:43.592001 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-bd4a5981-329f-49fe-aa11-03f2800aee6d req-b663d5c0-0807-4319-a2c3-afb832a046f9 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:43.592436 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-bd4a5981-329f-49fe-aa11-03f2800aee6d req-b663d5c0-0807-4319-a2c3-afb832a046f9 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:43.604920 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-bd4a5981-329f-49fe-aa11-03f2800aee6d req-b663d5c0-0807-4319-a2c3-afb832a046f9 service nova] Creating event network-vif-unplugged:34940ecb-c2a4-45ca-ad50-7ea9f112b22a for instance b664a08c-f97e-4c52-b849-9eddb2e65be5 on hv-cinder-76606 May 16 19:14:43.610265 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-bd4a5981-329f-49fe-aa11-03f2800aee6d req-b663d5c0-0807-4319-a2c3-afb832a046f9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033467 May 16 19:14:43.611035 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 503/975] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:44.214217 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-6d04f745-64be-4e4b-ab2e-2040b3180445 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:44.214618 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-6d04f745-64be-4e4b-ab2e-2040b3180445 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:44.221337 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6d04f745-64be-4e4b-ab2e-2040b3180445 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:44.221819 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6d04f745-64be-4e4b-ab2e-2040b3180445 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:44.222582 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6d04f745-64be-4e4b-ab2e-2040b3180445 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:44.223044 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6d04f745-64be-4e4b-ab2e-2040b3180445 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:44.352274 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6d04f745-64be-4e4b-ab2e-2040b3180445 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:44.359977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-6d04f745-64be-4e4b-ab2e-2040b3180445 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.149863 May 16 19:14:44.360557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 473/976] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:44 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:44.452673 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-142fefe4-4c47-4031-9e44-ea2a98be9b4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:44.453370 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-142fefe4-4c47-4031-9e44-ea2a98be9b4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:44.460537 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-142fefe4-4c47-4031-9e44-ea2a98be9b4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:44.460989 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-142fefe4-4c47-4031-9e44-ea2a98be9b4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:44.461767 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-142fefe4-4c47-4031-9e44-ea2a98be9b4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:44.462231 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-142fefe4-4c47-4031-9e44-ea2a98be9b4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:44.590212 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-142fefe4-4c47-4031-9e44-ea2a98be9b4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:44.598118 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-142fefe4-4c47-4031-9e44-ea2a98be9b4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:44.599563 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-142fefe4-4c47-4031-9e44-ea2a98be9b4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:44.600758 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-142fefe4-4c47-4031-9e44-ea2a98be9b4d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1722 microversion: 2.20 time: 0.152426 May 16 19:14:44.601563 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 504/977] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:44 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:45.376604 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-a67c5dc1-1c45-4670-86ac-0126c3c17955 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:45.377217 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-a67c5dc1-1c45-4670-86ac-0126c3c17955 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:45.383953 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a67c5dc1-1c45-4670-86ac-0126c3c17955 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:45.384391 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a67c5dc1-1c45-4670-86ac-0126c3c17955 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:45.385153 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a67c5dc1-1c45-4670-86ac-0126c3c17955 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:45.385584 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a67c5dc1-1c45-4670-86ac-0126c3c17955 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:45.525715 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-a67c5dc1-1c45-4670-86ac-0126c3c17955 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:45.535577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-a67c5dc1-1c45-4670-86ac-0126c3c17955 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.162980 May 16 19:14:45.536169 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 474/978] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:45 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:45.619311 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7b236ff7-107d-4b77-a4e2-7891aa3f2a60 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:45.620138 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7b236ff7-107d-4b77-a4e2-7891aa3f2a60 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:45.626829 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7b236ff7-107d-4b77-a4e2-7891aa3f2a60 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:45.627284 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7b236ff7-107d-4b77-a4e2-7891aa3f2a60 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:45.628058 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7b236ff7-107d-4b77-a4e2-7891aa3f2a60 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:45.628597 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7b236ff7-107d-4b77-a4e2-7891aa3f2a60 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:45.758744 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7b236ff7-107d-4b77-a4e2-7891aa3f2a60 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:45.767077 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7b236ff7-107d-4b77-a4e2-7891aa3f2a60 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:45.769178 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7b236ff7-107d-4b77-a4e2-7891aa3f2a60 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:45.770264 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7b236ff7-107d-4b77-a4e2-7891aa3f2a60 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1722 microversion: 2.20 time: 0.154951 May 16 19:14:45.770817 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 505/979] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:45 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:46.552559 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4026169b-659a-499e-9643-8a9129159adb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:46.553184 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-4026169b-659a-499e-9643-8a9129159adb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:46.561719 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4026169b-659a-499e-9643-8a9129159adb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:46.562176 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4026169b-659a-499e-9643-8a9129159adb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:46.562961 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4026169b-659a-499e-9643-8a9129159adb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:46.563405 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4026169b-659a-499e-9643-8a9129159adb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:46.631625 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-12e6c00b-f04f-4811-acb0-4fc965405b6a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:46.633099 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-12e6c00b-f04f-4811-acb0-4fc965405b6a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:46.643128 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-12e6c00b-f04f-4811-acb0-4fc965405b6a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:46.643802 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-12e6c00b-f04f-4811-acb0-4fc965405b6a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:46.644930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-12e6c00b-f04f-4811-acb0-4fc965405b6a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:46.645576 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-12e6c00b-f04f-4811-acb0-4fc965405b6a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:46.690827 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-12e6c00b-f04f-4811-acb0-4fc965405b6a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.064128 May 16 19:14:46.691806 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 506/980] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:14:46 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments => generated 371 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:14:46.737997 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4026169b-659a-499e-9643-8a9129159adb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:46.745897 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4026169b-659a-499e-9643-8a9129159adb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.197430 May 16 19:14:46.747067 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 475/981] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:46 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:46.788237 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9f9290c7-e4e9-4d1e-a3e2-a481a5d2fdc6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:46.788841 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9f9290c7-e4e9-4d1e-a3e2-a481a5d2fdc6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:46.795176 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9f9290c7-e4e9-4d1e-a3e2-a481a5d2fdc6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:46.795631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9f9290c7-e4e9-4d1e-a3e2-a481a5d2fdc6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:46.796412 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9f9290c7-e4e9-4d1e-a3e2-a481a5d2fdc6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:46.796847 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9f9290c7-e4e9-4d1e-a3e2-a481a5d2fdc6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:46.843831 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-11e75453-fc82-4155-9f03-38f894a7617b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:46.844332 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-11e75453-fc82-4155-9f03-38f894a7617b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:46.850469 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-11e75453-fc82-4155-9f03-38f894a7617b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:46.850922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-11e75453-fc82-4155-9f03-38f894a7617b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:46.851698 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-11e75453-fc82-4155-9f03-38f894a7617b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:46.852142 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-11e75453-fc82-4155-9f03-38f894a7617b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:46.945448 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9f9290c7-e4e9-4d1e-a3e2-a481a5d2fdc6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:46.954153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9f9290c7-e4e9-4d1e-a3e2-a481a5d2fdc6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:46.955792 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9f9290c7-e4e9-4d1e-a3e2-a481a5d2fdc6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:46.957095 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9f9290c7-e4e9-4d1e-a3e2-a481a5d2fdc6 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1665 microversion: 2.20 time: 0.172793 May 16 19:14:46.957783 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 507/982] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:46 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1665 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:46.978087 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-fa3b8abf-9526-4946-b098-6bcb37fb2e26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60d0361c-ec93-4a27-bcaa-4f5efc3bf5f0"}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:46.979284 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-fa3b8abf-9526-4946-b098-6bcb37fb2e26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:46.986249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fa3b8abf-9526-4946-b098-6bcb37fb2e26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:46.987244 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fa3b8abf-9526-4946-b098-6bcb37fb2e26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:46.988142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fa3b8abf-9526-4946-b098-6bcb37fb2e26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:46.988649 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fa3b8abf-9526-4946-b098-6bcb37fb2e26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:47.051451 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-11e75453-fc82-4155-9f03-38f894a7617b tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments/2eb8e12d-bbd7-42ea-baf5-687358063d81" status: 200 len: 194 microversion: 2.1 time: 0.211544 May 16 19:14:47.052740 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 476/983] 10.222.0.24 () {58 vars in 1412 bytes} [Mon May 16 19:14:46 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments/2eb8e12d-bbd7-42ea-baf5-687358063d81 => generated 194 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:47.062046 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8444c54a-9e72-45f1-94bd-eedf92df23ed tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:47.062528 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8444c54a-9e72-45f1-94bd-eedf92df23ed tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:47.068453 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8444c54a-9e72-45f1-94bd-eedf92df23ed tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:47.069595 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8444c54a-9e72-45f1-94bd-eedf92df23ed tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:47.070729 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8444c54a-9e72-45f1-94bd-eedf92df23ed tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:47.071500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8444c54a-9e72-45f1-94bd-eedf92df23ed tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:47.166700 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.objects.instance [None req-8444c54a-9e72-45f1-94bd-eedf92df23ed tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lazy-loading 'services' on Instance uuid ec122f45-8f35-47df-85df-f54da6781402 {{(pid=117275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:14:47.286139 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8444c54a-9e72-45f1-94bd-eedf92df23ed tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "DELETE /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments/2eb8e12d-bbd7-42ea-baf5-687358063d81" status: 202 len: 0 microversion: 2.1 time: 0.227607 May 16 19:14:47.286720 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 477/984] 10.222.0.24 () {58 vars in 1415 bytes} [Mon May 16 19:14:47 2022] DELETE /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments/2eb8e12d-bbd7-42ea-baf5-687358063d81 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 19:14:47.376063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-fa3b8abf-9526-4946-b098-6bcb37fb2e26 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "POST /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.404791 May 16 19:14:47.381691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 508/985] 10.222.0.24 () {62 vars in 1363 bytes} [Mon May 16 19:14:46 2022] POST /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5/os-volume_attachments => generated 188 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 19:14:47.489045 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f8061670-7583-48cf-9236-ffd4718694e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:47.489645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f8061670-7583-48cf-9236-ffd4718694e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:47.495778 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f8061670-7583-48cf-9236-ffd4718694e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:47.496236 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f8061670-7583-48cf-9236-ffd4718694e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:47.497038 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f8061670-7583-48cf-9236-ffd4718694e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:47.497462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f8061670-7583-48cf-9236-ffd4718694e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:47.698085 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-fc6d98b1-b957-437d-af9f-0788b3b4b646 req-ed9f2c9b-53e1-4a67-bdb8-1ba0b6fa3de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a385b0-58f3-4946-b6c6-2cbd20fe387f", "name": "network-vif-unplugged", "status": "completed", "tag": "aadd3356-5374-4e27-aec5-d1a129d4438b"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:47.710440 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-fc6d98b1-b957-437d-af9f-0788b3b4b646 req-ed9f2c9b-53e1-4a67-bdb8-1ba0b6fa3de8 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:47.711129 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-fc6d98b1-b957-437d-af9f-0788b3b4b646 req-ed9f2c9b-53e1-4a67-bdb8-1ba0b6fa3de8 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:47.734480 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.compute.server_external_events [req-fc6d98b1-b957-437d-af9f-0788b3b4b646 req-ed9f2c9b-53e1-4a67-bdb8-1ba0b6fa3de8 service nova] Unable to find a host for instance 96a385b0-58f3-4946-b6c6-2cbd20fe387f. Dropping event network-vif-unplugged {{(pid=117274) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 16 19:14:47.735666 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-fc6d98b1-b957-437d-af9f-0788b3b4b646 req-ed9f2c9b-53e1-4a67-bdb8-1ba0b6fa3de8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041877 May 16 19:14:47.736925 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 509/986] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 16 19:14:47.764238 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8ad67f4c-e3b4-4b38-bf72-7ce2f4feaf75 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:47.773974 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8ad67f4c-e3b4-4b38-bf72-7ce2f4feaf75 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:47.781482 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8ad67f4c-e3b4-4b38-bf72-7ce2f4feaf75 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:47.782301 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8ad67f4c-e3b4-4b38-bf72-7ce2f4feaf75 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:47.783039 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8ad67f4c-e3b4-4b38-bf72-7ce2f4feaf75 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:47.783656 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8ad67f4c-e3b4-4b38-bf72-7ce2f4feaf75 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:47.786589 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f8061670-7583-48cf-9236-ffd4718694e3 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5/os-volume_attachments/60d0361c-ec93-4a27-bcaa-4f5efc3bf5f0" status: 202 len: 0 microversion: 2.20 time: 0.301774 May 16 19:14:47.787367 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 478/987] 10.222.0.24 () {60 vars in 1456 bytes} [Mon May 16 19:14:47 2022] DELETE /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5/os-volume_attachments/60d0361c-ec93-4a27-bcaa-4f5efc3bf5f0 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 19:14:47.850801 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3eb804ae-f9f9-4bba-bf5a-ec4ca5fdb69f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:47.851368 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-3eb804ae-f9f9-4bba-bf5a-ec4ca5fdb69f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:47.858371 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3eb804ae-f9f9-4bba-bf5a-ec4ca5fdb69f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:47.859973 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3eb804ae-f9f9-4bba-bf5a-ec4ca5fdb69f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:47.861017 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3eb804ae-f9f9-4bba-bf5a-ec4ca5fdb69f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:47.862129 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-3eb804ae-f9f9-4bba-bf5a-ec4ca5fdb69f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:47.925395 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-8ad67f4c-e3b4-4b38-bf72-7ce2f4feaf75 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:47.933271 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8ad67f4c-e3b4-4b38-bf72-7ce2f4feaf75 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1509 microversion: 2.1 time: 0.173198 May 16 19:14:47.934100 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 510/988] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:47 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:47.950244 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8c4a1957-2e84-4926-9d80-9438e1fd22a5 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:14:47.951122 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-3eb804ae-f9f9-4bba-bf5a-ec4ca5fdb69f tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "POST /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5/action" status: 202 len: 0 microversion: 2.20 time: 0.104227 May 16 19:14:47.951284 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8c4a1957-2e84-4926-9d80-9438e1fd22a5 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:47.951914 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 479/989] 10.222.0.24 () {62 vars in 1318 bytes} [Mon May 16 19:14:47 2022] POST /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 16 19:14:47.960010 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1c9738fa-5a6a-4465-ada2-61412ebd84ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:47.960666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1c9738fa-5a6a-4465-ada2-61412ebd84ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:47.962559 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c4a1957-2e84-4926-9d80-9438e1fd22a5 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:47.963173 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c4a1957-2e84-4926-9d80-9438e1fd22a5 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:47.964128 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c4a1957-2e84-4926-9d80-9438e1fd22a5 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:47.964715 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8c4a1957-2e84-4926-9d80-9438e1fd22a5 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:47.967538 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1c9738fa-5a6a-4465-ada2-61412ebd84ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:47.968094 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1c9738fa-5a6a-4465-ada2-61412ebd84ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:47.969564 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1c9738fa-5a6a-4465-ada2-61412ebd84ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:47.969564 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1c9738fa-5a6a-4465-ada2-61412ebd84ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:48.105320 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8c4a1957-2e84-4926-9d80-9438e1fd22a5 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "POST /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f/action" status: 202 len: 0 microversion: 2.1 time: 0.159071 May 16 19:14:48.106401 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 511/990] 10.222.0.24 () {60 vars in 1277 bytes} [Mon May 16 19:14:47 2022] POST /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 19:14:48.114100 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c3858226-9f03-4505-a0b1-e80fce74fd05 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:48.114849 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c3858226-9f03-4505-a0b1-e80fce74fd05 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:48.124732 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c3858226-9f03-4505-a0b1-e80fce74fd05 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:48.125454 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c3858226-9f03-4505-a0b1-e80fce74fd05 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:48.126509 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c3858226-9f03-4505-a0b1-e80fce74fd05 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:48.127153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c3858226-9f03-4505-a0b1-e80fce74fd05 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:48.162481 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1c9738fa-5a6a-4465-ada2-61412ebd84ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:48.180915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1c9738fa-5a6a-4465-ada2-61412ebd84ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:48.182452 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1c9738fa-5a6a-4465-ada2-61412ebd84ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:48.185224 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1c9738fa-5a6a-4465-ada2-61412ebd84ef tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1673 microversion: 2.20 time: 0.227706 May 16 19:14:48.186658 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 480/991] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:47 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1673 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:48.370799 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c3858226-9f03-4505-a0b1-e80fce74fd05 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:48.379803 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c3858226-9f03-4505-a0b1-e80fce74fd05 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1517 microversion: 2.1 time: 0.269548 May 16 19:14:48.381174 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 512/992] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:48 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1517 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:14:48.418901 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-83e45a28-d43e-4610-991a-cb200835ba38 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:48.419902 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-83e45a28-d43e-4610-991a-cb200835ba38 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:48.426738 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-83e45a28-d43e-4610-991a-cb200835ba38 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:48.427191 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-83e45a28-d43e-4610-991a-cb200835ba38 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:48.427987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-83e45a28-d43e-4610-991a-cb200835ba38 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:48.428451 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-83e45a28-d43e-4610-991a-cb200835ba38 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:48.469338 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-83e45a28-d43e-4610-991a-cb200835ba38 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments/b55d46df-7f82-480d-a3aa-eff098da1e0d" status: 200 len: 194 microversion: 2.1 time: 0.054801 May 16 19:14:48.470583 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 481/993] 10.222.0.24 () {58 vars in 1412 bytes} [Mon May 16 19:14:48 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments/b55d46df-7f82-480d-a3aa-eff098da1e0d => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:14:48.481599 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ea0a76d3-0a2d-4bde-86a8-e0ce97f75bd1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:48.482104 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ea0a76d3-0a2d-4bde-86a8-e0ce97f75bd1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:48.489328 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ea0a76d3-0a2d-4bde-86a8-e0ce97f75bd1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:48.489808 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ea0a76d3-0a2d-4bde-86a8-e0ce97f75bd1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:48.493999 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ea0a76d3-0a2d-4bde-86a8-e0ce97f75bd1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:48.494452 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ea0a76d3-0a2d-4bde-86a8-e0ce97f75bd1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:48.594547 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-ea0a76d3-0a2d-4bde-86a8-e0ce97f75bd1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lazy-loading 'services' on Instance uuid ec122f45-8f35-47df-85df-f54da6781402 {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:14:48.693104 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ea0a76d3-0a2d-4bde-86a8-e0ce97f75bd1 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "DELETE /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments/b55d46df-7f82-480d-a3aa-eff098da1e0d" status: 202 len: 0 microversion: 2.1 time: 0.215572 May 16 19:14:48.694645 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 513/994] 10.222.0.24 () {58 vars in 1415 bytes} [Mon May 16 19:14:48 2022] DELETE /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments/b55d46df-7f82-480d-a3aa-eff098da1e0d => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 19:14:49.204415 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-503c2b75-ce7e-47e3-8a07-ff1eed25aab9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:49.205166 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-503c2b75-ce7e-47e3-8a07-ff1eed25aab9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:49.211878 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-503c2b75-ce7e-47e3-8a07-ff1eed25aab9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:49.212325 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-503c2b75-ce7e-47e3-8a07-ff1eed25aab9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:49.213214 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-503c2b75-ce7e-47e3-8a07-ff1eed25aab9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:49.213670 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-503c2b75-ce7e-47e3-8a07-ff1eed25aab9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:49.343631 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-503c2b75-ce7e-47e3-8a07-ff1eed25aab9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:49.352616 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-503c2b75-ce7e-47e3-8a07-ff1eed25aab9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:49.354604 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-503c2b75-ce7e-47e3-8a07-ff1eed25aab9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:49.356008 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-503c2b75-ce7e-47e3-8a07-ff1eed25aab9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.155480 May 16 19:14:49.356631 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 482/995] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:49 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:49.400057 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ae8293c5-e1a3-4376-b424-66238c62688e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:49.400902 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ae8293c5-e1a3-4376-b424-66238c62688e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:49.411311 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ae8293c5-e1a3-4376-b424-66238c62688e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:49.411722 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ae8293c5-e1a3-4376-b424-66238c62688e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:49.416523 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ae8293c5-e1a3-4376-b424-66238c62688e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:49.417120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ae8293c5-e1a3-4376-b424-66238c62688e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:49.576459 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ae8293c5-e1a3-4376-b424-66238c62688e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:49.586892 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ae8293c5-e1a3-4376-b424-66238c62688e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1519 microversion: 2.1 time: 0.189797 May 16 19:14:49.586892 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 514/996] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:49 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:49.876467 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5d13c373-df4d-4380-b433-bf7a4801fb9f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:49.877630 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5d13c373-df4d-4380-b433-bf7a4801fb9f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:49.886155 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d13c373-df4d-4380-b433-bf7a4801fb9f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:49.886624 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d13c373-df4d-4380-b433-bf7a4801fb9f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:49.887899 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d13c373-df4d-4380-b433-bf7a4801fb9f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:49.888511 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5d13c373-df4d-4380-b433-bf7a4801fb9f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:49.919588 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5d13c373-df4d-4380-b433-bf7a4801fb9f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047420 May 16 19:14:49.920162 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 483/997] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:14:49 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 19:14:50.039511 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-daceb9e7-d20c-40ea-b1ba-42f318fd7508 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:50.040942 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-daceb9e7-d20c-40ea-b1ba-42f318fd7508 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:50.050017 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-daceb9e7-d20c-40ea-b1ba-42f318fd7508 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:50.050461 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-daceb9e7-d20c-40ea-b1ba-42f318fd7508 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:50.051886 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-daceb9e7-d20c-40ea-b1ba-42f318fd7508 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:50.052317 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-daceb9e7-d20c-40ea-b1ba-42f318fd7508 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:50.089618 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-daceb9e7-d20c-40ea-b1ba-42f318fd7508 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056071 May 16 19:14:50.090350 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 515/998] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:14:50 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 19:14:50.152143 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-382edbff-4ff4-4e87-b9a7-bfac9541a27d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:50.152708 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-382edbff-4ff4-4e87-b9a7-bfac9541a27d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:50.158866 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-382edbff-4ff4-4e87-b9a7-bfac9541a27d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:50.159604 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-382edbff-4ff4-4e87-b9a7-bfac9541a27d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:50.160679 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-382edbff-4ff4-4e87-b9a7-bfac9541a27d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:50.161337 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-382edbff-4ff4-4e87-b9a7-bfac9541a27d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:50.189473 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-382edbff-4ff4-4e87-b9a7-bfac9541a27d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Going to try to terminate instance {{(pid=117275) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:14:50.300713 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-382edbff-4ff4-4e87-b9a7-bfac9541a27d tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "DELETE /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 204 len: 0 microversion: 2.1 time: 0.151226 May 16 19:14:50.302798 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 484/999] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:14:50 2022] DELETE /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 19:14:50.312013 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-25eee131-56b1-4ccf-b1b0-b67d14328582 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:50.312636 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-25eee131-56b1-4ccf-b1b0-b67d14328582 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:50.319717 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-25eee131-56b1-4ccf-b1b0-b67d14328582 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:50.320030 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-25eee131-56b1-4ccf-b1b0-b67d14328582 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:50.328353 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-25eee131-56b1-4ccf-b1b0-b67d14328582 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:50.329112 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-25eee131-56b1-4ccf-b1b0-b67d14328582 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:50.375323 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b7638f04-b6a3-4b85-9213-e9f13913b21d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:50.376474 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b7638f04-b6a3-4b85-9213-e9f13913b21d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:50.386931 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b7638f04-b6a3-4b85-9213-e9f13913b21d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:50.387610 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b7638f04-b6a3-4b85-9213-e9f13913b21d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:50.388750 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b7638f04-b6a3-4b85-9213-e9f13913b21d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:50.389373 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b7638f04-b6a3-4b85-9213-e9f13913b21d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:50.490892 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-25eee131-56b1-4ccf-b1b0-b67d14328582 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:50.501866 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-25eee131-56b1-4ccf-b1b0-b67d14328582 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1671 microversion: 2.1 time: 0.194643 May 16 19:14:50.512844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 516/1000] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:50 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1671 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:50.564484 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b7638f04-b6a3-4b85-9213-e9f13913b21d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:50.573745 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b7638f04-b6a3-4b85-9213-e9f13913b21d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:50.575302 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b7638f04-b6a3-4b85-9213-e9f13913b21d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:50.576481 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b7638f04-b6a3-4b85-9213-e9f13913b21d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.205532 May 16 19:14:50.577985 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 485/1001] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:50 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:50.601836 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-97c7282d-e735-44c9-9454-b331470e47ff tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:50.602477 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-97c7282d-e735-44c9-9454-b331470e47ff tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:50.617928 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-97c7282d-e735-44c9-9454-b331470e47ff tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:50.618381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-97c7282d-e735-44c9-9454-b331470e47ff tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:50.619159 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-97c7282d-e735-44c9-9454-b331470e47ff tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:50.619677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-97c7282d-e735-44c9-9454-b331470e47ff tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:50.796852 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-97c7282d-e735-44c9-9454-b331470e47ff tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:50.804793 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-97c7282d-e735-44c9-9454-b331470e47ff tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.207147 May 16 19:14:50.805550 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 517/1002] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:50 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:51.522982 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5dc2ace7-5d12-4d64-b47b-b0042982f810 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:51.523624 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5dc2ace7-5d12-4d64-b47b-b0042982f810 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:51.531292 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5dc2ace7-5d12-4d64-b47b-b0042982f810 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:51.531739 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5dc2ace7-5d12-4d64-b47b-b0042982f810 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:51.532528 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5dc2ace7-5d12-4d64-b47b-b0042982f810 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:51.532962 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5dc2ace7-5d12-4d64-b47b-b0042982f810 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:51.597135 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-dc271575-900b-485b-a7d6-aae7fa2e2f62 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:51.598008 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-dc271575-900b-485b-a7d6-aae7fa2e2f62 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:51.604275 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dc271575-900b-485b-a7d6-aae7fa2e2f62 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:51.604753 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dc271575-900b-485b-a7d6-aae7fa2e2f62 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:51.605642 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dc271575-900b-485b-a7d6-aae7fa2e2f62 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:51.606115 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dc271575-900b-485b-a7d6-aae7fa2e2f62 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:51.674419 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-5dc2ace7-5d12-4d64-b47b-b0042982f810 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:51.682070 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5dc2ace7-5d12-4d64-b47b-b0042982f810 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1671 microversion: 2.1 time: 0.165395 May 16 19:14:51.682634 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 486/1003] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:51 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:51.741011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-dc271575-900b-485b-a7d6-aae7fa2e2f62 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:51.749234 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-dc271575-900b-485b-a7d6-aae7fa2e2f62 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:51.750772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-dc271575-900b-485b-a7d6-aae7fa2e2f62 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:51.751952 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-dc271575-900b-485b-a7d6-aae7fa2e2f62 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.158946 May 16 19:14:51.752528 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 518/1004] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:51 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:51.822673 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-53fd4f55-f776-48c7-a888-ad5c792fbc2d tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:51.823283 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-53fd4f55-f776-48c7-a888-ad5c792fbc2d tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:51.829660 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-53fd4f55-f776-48c7-a888-ad5c792fbc2d tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:51.830099 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-53fd4f55-f776-48c7-a888-ad5c792fbc2d tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:51.830856 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-53fd4f55-f776-48c7-a888-ad5c792fbc2d tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:51.831279 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-53fd4f55-f776-48c7-a888-ad5c792fbc2d tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:51.987140 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-53fd4f55-f776-48c7-a888-ad5c792fbc2d tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:51.997680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-53fd4f55-f776-48c7-a888-ad5c792fbc2d tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.178782 May 16 19:14:51.998557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 487/1005] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:51 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:52.699922 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-837fecfd-114e-4759-adfd-3a29c3e5e9bf tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:52.701299 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-837fecfd-114e-4759-adfd-3a29c3e5e9bf tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:52.709008 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-837fecfd-114e-4759-adfd-3a29c3e5e9bf tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:52.709648 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-837fecfd-114e-4759-adfd-3a29c3e5e9bf tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:52.710689 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-837fecfd-114e-4759-adfd-3a29c3e5e9bf tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:52.711345 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-837fecfd-114e-4759-adfd-3a29c3e5e9bf tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:52.771021 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-665bf017-8788-4a6b-bbd4-00ff7170f98d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:52.772594 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-665bf017-8788-4a6b-bbd4-00ff7170f98d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:52.780563 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-665bf017-8788-4a6b-bbd4-00ff7170f98d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:52.781669 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-665bf017-8788-4a6b-bbd4-00ff7170f98d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:52.782680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-665bf017-8788-4a6b-bbd4-00ff7170f98d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:52.783274 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-665bf017-8788-4a6b-bbd4-00ff7170f98d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:52.930673 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-837fecfd-114e-4759-adfd-3a29c3e5e9bf tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:52.938910 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-837fecfd-114e-4759-adfd-3a29c3e5e9bf tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1671 microversion: 2.1 time: 0.243252 May 16 19:14:52.939466 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 519/1006] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:52 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1671 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:52.956704 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-665bf017-8788-4a6b-bbd4-00ff7170f98d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:52.965337 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-665bf017-8788-4a6b-bbd4-00ff7170f98d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:52.967441 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-665bf017-8788-4a6b-bbd4-00ff7170f98d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:52.968924 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-665bf017-8788-4a6b-bbd4-00ff7170f98d tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.202394 May 16 19:14:52.973654 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 488/1007] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:52 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:14:53.015032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ba67fd47-7974-472b-a838-8c842cb3c2d1 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:53.015643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ba67fd47-7974-472b-a838-8c842cb3c2d1 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:53.022289 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ba67fd47-7974-472b-a838-8c842cb3c2d1 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:53.022735 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ba67fd47-7974-472b-a838-8c842cb3c2d1 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:53.023490 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ba67fd47-7974-472b-a838-8c842cb3c2d1 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:53.023923 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ba67fd47-7974-472b-a838-8c842cb3c2d1 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:53.159927 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ba67fd47-7974-472b-a838-8c842cb3c2d1 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:53.177734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ba67fd47-7974-472b-a838-8c842cb3c2d1 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.166563 May 16 19:14:53.178318 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 520/1008] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:53 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:53.956810 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f2d7bb8e-c613-4a7e-8758-115232407a2e tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:53.957728 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f2d7bb8e-c613-4a7e-8758-115232407a2e tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:53.964145 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f2d7bb8e-c613-4a7e-8758-115232407a2e tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:53.964602 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f2d7bb8e-c613-4a7e-8758-115232407a2e tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:53.965472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f2d7bb8e-c613-4a7e-8758-115232407a2e tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:53.965937 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f2d7bb8e-c613-4a7e-8758-115232407a2e tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:53.988314 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-394a8386-2380-4e54-bbd6-e81c03bc46b1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:53.988314 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-394a8386-2380-4e54-bbd6-e81c03bc46b1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:53.999439 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-394a8386-2380-4e54-bbd6-e81c03bc46b1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:54.000452 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-394a8386-2380-4e54-bbd6-e81c03bc46b1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:54.001765 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-394a8386-2380-4e54-bbd6-e81c03bc46b1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:54.002209 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-394a8386-2380-4e54-bbd6-e81c03bc46b1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:54.211931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-394a8386-2380-4e54-bbd6-e81c03bc46b1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:54.221697 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-394a8386-2380-4e54-bbd6-e81c03bc46b1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:54.223677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-394a8386-2380-4e54-bbd6-e81c03bc46b1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:54.225107 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-394a8386-2380-4e54-bbd6-e81c03bc46b1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.242111 May 16 19:14:54.225925 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 521/1009] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:53 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:54.238077 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b2483c55-47a0-435d-ae0a-d3492b708185 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:54.239002 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b2483c55-47a0-435d-ae0a-d3492b708185 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:54.246414 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b2483c55-47a0-435d-ae0a-d3492b708185 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:54.247184 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b2483c55-47a0-435d-ae0a-d3492b708185 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:54.248180 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b2483c55-47a0-435d-ae0a-d3492b708185 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:54.248768 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b2483c55-47a0-435d-ae0a-d3492b708185 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:54.495742 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b2483c55-47a0-435d-ae0a-d3492b708185 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:54.505694 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b2483c55-47a0-435d-ae0a-d3492b708185 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.278479 May 16 19:14:54.507059 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 522/1010] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:54 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:54.553373 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f2d7bb8e-c613-4a7e-8758-115232407a2e tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:54.561232 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f2d7bb8e-c613-4a7e-8758-115232407a2e tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1671 microversion: 2.1 time: 0.608254 May 16 19:14:54.562375 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 489/1011] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:53 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1671 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:55.244144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c1b9e727-4916-49d3-8c96-ea30dd7bf14a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:55.244776 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c1b9e727-4916-49d3-8c96-ea30dd7bf14a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:55.252219 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c1b9e727-4916-49d3-8c96-ea30dd7bf14a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:55.252395 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c1b9e727-4916-49d3-8c96-ea30dd7bf14a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:55.253606 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c1b9e727-4916-49d3-8c96-ea30dd7bf14a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:55.254269 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c1b9e727-4916-49d3-8c96-ea30dd7bf14a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:55.410280 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c1b9e727-4916-49d3-8c96-ea30dd7bf14a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:55.418523 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c1b9e727-4916-49d3-8c96-ea30dd7bf14a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:55.419942 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c1b9e727-4916-49d3-8c96-ea30dd7bf14a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:55.421104 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c1b9e727-4916-49d3-8c96-ea30dd7bf14a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.180980 May 16 19:14:55.421704 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 523/1012] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:55 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:55.525497 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-20be2a33-8538-481d-b78e-9453b8341585 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:55.526315 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-20be2a33-8538-481d-b78e-9453b8341585 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:55.533844 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-20be2a33-8538-481d-b78e-9453b8341585 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:55.534603 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-20be2a33-8538-481d-b78e-9453b8341585 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:55.535396 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-20be2a33-8538-481d-b78e-9453b8341585 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:55.535826 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-20be2a33-8538-481d-b78e-9453b8341585 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:55.580683 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-08e24111-89c2-4821-bcbe-1bac849ad60f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:55.581796 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-08e24111-89c2-4821-bcbe-1bac849ad60f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:55.588247 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-08e24111-89c2-4821-bcbe-1bac849ad60f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:55.590431 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-08e24111-89c2-4821-bcbe-1bac849ad60f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:55.591562 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-08e24111-89c2-4821-bcbe-1bac849ad60f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:55.592336 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-08e24111-89c2-4821-bcbe-1bac849ad60f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:55.700455 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-20be2a33-8538-481d-b78e-9453b8341585 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:55.710563 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-20be2a33-8538-481d-b78e-9453b8341585 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.189518 May 16 19:14:55.711743 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 490/1013] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:55 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:55.758710 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-08e24111-89c2-4821-bcbe-1bac849ad60f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:55.768668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-08e24111-89c2-4821-bcbe-1bac849ad60f tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1671 microversion: 2.1 time: 0.192486 May 16 19:14:55.769461 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 524/1014] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:55 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1671 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:56.439946 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-cc10a978-eb32-495f-86f9-cf072d9af63b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:56.440557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-cc10a978-eb32-495f-86f9-cf072d9af63b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:56.446560 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cc10a978-eb32-495f-86f9-cf072d9af63b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:56.446996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cc10a978-eb32-495f-86f9-cf072d9af63b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:56.447966 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cc10a978-eb32-495f-86f9-cf072d9af63b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:56.448396 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cc10a978-eb32-495f-86f9-cf072d9af63b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:56.606119 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-cc10a978-eb32-495f-86f9-cf072d9af63b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:56.614642 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-cc10a978-eb32-495f-86f9-cf072d9af63b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:56.616221 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-cc10a978-eb32-495f-86f9-cf072d9af63b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:56.617399 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-cc10a978-eb32-495f-86f9-cf072d9af63b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.181668 May 16 19:14:56.617982 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 491/1015] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:56 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:14:56.729238 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-42dfb3cb-17ca-4ed7-bc1e-854c2354b3e2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:56.730616 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-42dfb3cb-17ca-4ed7-bc1e-854c2354b3e2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:56.744923 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-42dfb3cb-17ca-4ed7-bc1e-854c2354b3e2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:56.745691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-42dfb3cb-17ca-4ed7-bc1e-854c2354b3e2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:56.746468 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-42dfb3cb-17ca-4ed7-bc1e-854c2354b3e2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:56.746898 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-42dfb3cb-17ca-4ed7-bc1e-854c2354b3e2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:56.786854 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c0ea97e1-0e08-416e-803b-543f41f6bd45 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:56.788213 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c0ea97e1-0e08-416e-803b-543f41f6bd45 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:56.802909 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c0ea97e1-0e08-416e-803b-543f41f6bd45 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:56.803766 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c0ea97e1-0e08-416e-803b-543f41f6bd45 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:56.805561 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c0ea97e1-0e08-416e-803b-543f41f6bd45 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:56.806211 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c0ea97e1-0e08-416e-803b-543f41f6bd45 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:56.933937 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-42dfb3cb-17ca-4ed7-bc1e-854c2354b3e2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:56.951003 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-42dfb3cb-17ca-4ed7-bc1e-854c2354b3e2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.225587 May 16 19:14:56.951753 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 525/1016] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:56 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:56.984439 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c0ea97e1-0e08-416e-803b-543f41f6bd45 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:56.995579 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c0ea97e1-0e08-416e-803b-543f41f6bd45 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1671 microversion: 2.1 time: 0.213303 May 16 19:14:56.996858 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 492/1017] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:56 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1671 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:14:57.636655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ec08d35a-887b-4703-9645-7087db62c2cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:57.637646 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ec08d35a-887b-4703-9645-7087db62c2cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:57.649343 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec08d35a-887b-4703-9645-7087db62c2cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:57.649828 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec08d35a-887b-4703-9645-7087db62c2cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:57.650621 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec08d35a-887b-4703-9645-7087db62c2cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:57.652761 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec08d35a-887b-4703-9645-7087db62c2cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:57.828275 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ec08d35a-887b-4703-9645-7087db62c2cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:57.841104 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ec08d35a-887b-4703-9645-7087db62c2cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:57.842921 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ec08d35a-887b-4703-9645-7087db62c2cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:57.844259 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ec08d35a-887b-4703-9645-7087db62c2cb tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.212430 May 16 19:14:57.845568 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 526/1018] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:57 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:57.968217 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4305a266-5767-405c-a7bc-c3eb85d132d1 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:57.968951 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-4305a266-5767-405c-a7bc-c3eb85d132d1 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:57.976389 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4305a266-5767-405c-a7bc-c3eb85d132d1 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:57.976835 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4305a266-5767-405c-a7bc-c3eb85d132d1 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:57.977621 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4305a266-5767-405c-a7bc-c3eb85d132d1 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:57.978237 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4305a266-5767-405c-a7bc-c3eb85d132d1 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:58.013853 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b26a4fc6-b8cd-4bae-8723-5203817e8fd7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:58.014782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b26a4fc6-b8cd-4bae-8723-5203817e8fd7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:58.026108 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b26a4fc6-b8cd-4bae-8723-5203817e8fd7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:58.027484 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b26a4fc6-b8cd-4bae-8723-5203817e8fd7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:58.028893 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b26a4fc6-b8cd-4bae-8723-5203817e8fd7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:58.029940 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b26a4fc6-b8cd-4bae-8723-5203817e8fd7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:58.177818 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4305a266-5767-405c-a7bc-c3eb85d132d1 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:58.185553 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4305a266-5767-405c-a7bc-c3eb85d132d1 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.221305 May 16 19:14:58.196472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 493/1019] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:57 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:58.217209 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b26a4fc6-b8cd-4bae-8723-5203817e8fd7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:58.226040 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b26a4fc6-b8cd-4bae-8723-5203817e8fd7 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1671 microversion: 2.1 time: 0.217149 May 16 19:14:58.226767 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 527/1020] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:58 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1671 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:58.866364 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ce5eef52-f55b-43e8-a3c3-9eb3c9e9609c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:58.866943 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ce5eef52-f55b-43e8-a3c3-9eb3c9e9609c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:58.872976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ce5eef52-f55b-43e8-a3c3-9eb3c9e9609c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:58.873425 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ce5eef52-f55b-43e8-a3c3-9eb3c9e9609c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:58.874237 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ce5eef52-f55b-43e8-a3c3-9eb3c9e9609c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:58.874672 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ce5eef52-f55b-43e8-a3c3-9eb3c9e9609c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:59.023045 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ce5eef52-f55b-43e8-a3c3-9eb3c9e9609c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:59.032713 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ce5eef52-f55b-43e8-a3c3-9eb3c9e9609c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:59.034308 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ce5eef52-f55b-43e8-a3c3-9eb3c9e9609c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:59.035494 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ce5eef52-f55b-43e8-a3c3-9eb3c9e9609c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.173357 May 16 19:14:59.036432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 494/1021] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:14:58 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:14:59.204069 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ece66bbd-ef6f-4b7b-bafd-07f3edcb30b6 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:59.205001 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ece66bbd-ef6f-4b7b-bafd-07f3edcb30b6 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:59.212001 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ece66bbd-ef6f-4b7b-bafd-07f3edcb30b6 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:59.212592 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ece66bbd-ef6f-4b7b-bafd-07f3edcb30b6 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:59.213462 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ece66bbd-ef6f-4b7b-bafd-07f3edcb30b6 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:59.213989 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ece66bbd-ef6f-4b7b-bafd-07f3edcb30b6 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:59.245013 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1845f283-3da6-4cf9-8968-a6447deb6b18 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:14:59.246294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1845f283-3da6-4cf9-8968-a6447deb6b18 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:14:59.254278 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1845f283-3da6-4cf9-8968-a6447deb6b18 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:59.254931 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1845f283-3da6-4cf9-8968-a6447deb6b18 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:59.256180 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1845f283-3da6-4cf9-8968-a6447deb6b18 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:14:59.256967 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1845f283-3da6-4cf9-8968-a6447deb6b18 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:14:59.384068 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ece66bbd-ef6f-4b7b-bafd-07f3edcb30b6 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:59.391752 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ece66bbd-ef6f-4b7b-bafd-07f3edcb30b6 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.191675 May 16 19:14:59.392658 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 528/1022] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:59 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:14:59.444205 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1845f283-3da6-4cf9-8968-a6447deb6b18 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:14:59.453736 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1845f283-3da6-4cf9-8968-a6447deb6b18 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1671 microversion: 2.1 time: 0.215013 May 16 19:14:59.454850 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 495/1023] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:14:59 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1671 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:00.054542 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-16c74c67-1f93-4482-9e5c-67170b584f08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:00.055184 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-16c74c67-1f93-4482-9e5c-67170b584f08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:00.062136 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-16c74c67-1f93-4482-9e5c-67170b584f08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:00.062913 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-16c74c67-1f93-4482-9e5c-67170b584f08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:00.064072 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-16c74c67-1f93-4482-9e5c-67170b584f08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:00.064808 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-16c74c67-1f93-4482-9e5c-67170b584f08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:00.231420 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-16c74c67-1f93-4482-9e5c-67170b584f08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:00.241330 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-16c74c67-1f93-4482-9e5c-67170b584f08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:00.243070 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-16c74c67-1f93-4482-9e5c-67170b584f08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:00.244307 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-16c74c67-1f93-4482-9e5c-67170b584f08 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.194072 May 16 19:15:00.244875 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 529/1024] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:15:00 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:15:00.408527 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c9073884-6dc3-43cc-80e4-d33fe7777ee0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:00.409907 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-c9073884-6dc3-43cc-80e4-d33fe7777ee0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:00.417050 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c9073884-6dc3-43cc-80e4-d33fe7777ee0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:00.417774 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c9073884-6dc3-43cc-80e4-d33fe7777ee0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:00.418725 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c9073884-6dc3-43cc-80e4-d33fe7777ee0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:00.419181 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-c9073884-6dc3-43cc-80e4-d33fe7777ee0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:00.472318 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e14fd556-49b8-4b45-9331-f6beadad8ccb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:00.472951 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e14fd556-49b8-4b45-9331-f6beadad8ccb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:00.482913 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e14fd556-49b8-4b45-9331-f6beadad8ccb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:00.483359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e14fd556-49b8-4b45-9331-f6beadad8ccb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:00.484152 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e14fd556-49b8-4b45-9331-f6beadad8ccb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:00.484580 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e14fd556-49b8-4b45-9331-f6beadad8ccb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:00.637579 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-c9073884-6dc3-43cc-80e4-d33fe7777ee0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:00.646079 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c9073884-6dc3-43cc-80e4-d33fe7777ee0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.241500 May 16 19:15:00.651538 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 496/1025] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:00 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:00.695191 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e14fd556-49b8-4b45-9331-f6beadad8ccb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:00.713135 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e14fd556-49b8-4b45-9331-f6beadad8ccb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1671 microversion: 2.1 time: 0.235421 May 16 19:15:00.715251 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 530/1026] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:00 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1671 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:15:01.266619 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f80477a9-574d-4bf1-af6c-d346c627b6c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:01.268048 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f80477a9-574d-4bf1-af6c-d346c627b6c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:01.278605 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f80477a9-574d-4bf1-af6c-d346c627b6c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:01.279182 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f80477a9-574d-4bf1-af6c-d346c627b6c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:01.279962 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f80477a9-574d-4bf1-af6c-d346c627b6c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:01.280380 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f80477a9-574d-4bf1-af6c-d346c627b6c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:01.419545 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f80477a9-574d-4bf1-af6c-d346c627b6c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:01.428421 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f80477a9-574d-4bf1-af6c-d346c627b6c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:01.430060 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f80477a9-574d-4bf1-af6c-d346c627b6c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:01.431245 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f80477a9-574d-4bf1-af6c-d346c627b6c2 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.171494 May 16 19:15:01.431785 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 497/1027] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:15:01 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:15:01.673764 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-36deefda-e0bd-49f7-8199-8c8da4d788b3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:01.674497 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-36deefda-e0bd-49f7-8199-8c8da4d788b3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:01.682419 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-36deefda-e0bd-49f7-8199-8c8da4d788b3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:01.683356 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-36deefda-e0bd-49f7-8199-8c8da4d788b3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:01.684409 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-36deefda-e0bd-49f7-8199-8c8da4d788b3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:01.684957 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-36deefda-e0bd-49f7-8199-8c8da4d788b3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:01.721584 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-75c8f328-92e6-404b-a7ad-b28dd14d1bbb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:01.722216 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-75c8f328-92e6-404b-a7ad-b28dd14d1bbb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:01.728835 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-75c8f328-92e6-404b-a7ad-b28dd14d1bbb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:01.729277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-75c8f328-92e6-404b-a7ad-b28dd14d1bbb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:01.730105 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-75c8f328-92e6-404b-a7ad-b28dd14d1bbb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:01.730548 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-75c8f328-92e6-404b-a7ad-b28dd14d1bbb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:01.845572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-36deefda-e0bd-49f7-8199-8c8da4d788b3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:01.854265 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-36deefda-e0bd-49f7-8199-8c8da4d788b3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.188390 May 16 19:15:01.854851 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 531/1028] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:01 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:01.897898 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-75c8f328-92e6-404b-a7ad-b28dd14d1bbb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:01.905719 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-75c8f328-92e6-404b-a7ad-b28dd14d1bbb tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1671 microversion: 2.1 time: 0.187978 May 16 19:15:01.906346 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 498/1029] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:01 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1671 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:02.454093 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-1d997102-6c70-49b5-987f-895c34cdfae8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:02.454966 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-1d997102-6c70-49b5-987f-895c34cdfae8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:02.465368 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1d997102-6c70-49b5-987f-895c34cdfae8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:02.466153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1d997102-6c70-49b5-987f-895c34cdfae8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:02.467416 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1d997102-6c70-49b5-987f-895c34cdfae8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:02.468119 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1d997102-6c70-49b5-987f-895c34cdfae8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:02.611104 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-1d997102-6c70-49b5-987f-895c34cdfae8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:02.623253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-1d997102-6c70-49b5-987f-895c34cdfae8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:02.625755 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-1d997102-6c70-49b5-987f-895c34cdfae8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:02.627670 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-1d997102-6c70-49b5-987f-895c34cdfae8 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.180246 May 16 19:15:02.628600 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 532/1030] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:15:02 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:15:02.875851 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4d67b83b-2405-4d63-b27d-72ae48d81b67 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:02.876685 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-4d67b83b-2405-4d63-b27d-72ae48d81b67 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:02.887542 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4d67b83b-2405-4d63-b27d-72ae48d81b67 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:02.888321 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4d67b83b-2405-4d63-b27d-72ae48d81b67 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:02.889627 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4d67b83b-2405-4d63-b27d-72ae48d81b67 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:02.890575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4d67b83b-2405-4d63-b27d-72ae48d81b67 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:02.922982 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-3088eba4-24cb-4625-bf10-8a3105f48133 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:02.923669 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-3088eba4-24cb-4625-bf10-8a3105f48133 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:02.930375 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3088eba4-24cb-4625-bf10-8a3105f48133 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:02.930897 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3088eba4-24cb-4625-bf10-8a3105f48133 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:02.931742 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3088eba4-24cb-4625-bf10-8a3105f48133 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:02.932208 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3088eba4-24cb-4625-bf10-8a3105f48133 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:03.031002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-4d67b83b-2405-4d63-b27d-72ae48d81b67 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:03.038729 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4d67b83b-2405-4d63-b27d-72ae48d81b67 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.169685 May 16 19:15:03.039305 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 499/1031] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:02 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:03.065167 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-3088eba4-24cb-4625-bf10-8a3105f48133 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:03.072638 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-3088eba4-24cb-4625-bf10-8a3105f48133 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1671 microversion: 2.1 time: 0.153703 May 16 19:15:03.073196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 533/1032] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:02 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:03.653621 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-19cf8e41-9d86-4051-a058-253b389103e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:03.654649 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-19cf8e41-9d86-4051-a058-253b389103e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:03.661347 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-19cf8e41-9d86-4051-a058-253b389103e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:03.661819 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-19cf8e41-9d86-4051-a058-253b389103e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:03.662581 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-19cf8e41-9d86-4051-a058-253b389103e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:03.663007 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-19cf8e41-9d86-4051-a058-253b389103e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:03.775364 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e9c63b23-cbb1-4281-8a67-3f6ba51c92f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:03.775944 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e9c63b23-cbb1-4281-8a67-3f6ba51c92f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:03.782026 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e9c63b23-cbb1-4281-8a67-3f6ba51c92f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:03.782481 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e9c63b23-cbb1-4281-8a67-3f6ba51c92f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:03.783288 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e9c63b23-cbb1-4281-8a67-3f6ba51c92f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:03.783693 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e9c63b23-cbb1-4281-8a67-3f6ba51c92f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:03.807427 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e9c63b23-cbb1-4281-8a67-3f6ba51c92f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd/ips" status: 200 len: 149 microversion: 2.1 time: 0.036003 May 16 19:15:03.808059 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 534/1033] 10.222.0.24 () {58 vars in 1247 bytes} [Mon May 16 19:15:03 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:15:03.808281 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-19cf8e41-9d86-4051-a058-253b389103e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:03.816647 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-19cf8e41-9d86-4051-a058-253b389103e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:03.818167 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-19cf8e41-9d86-4051-a058-253b389103e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:03.819321 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-19cf8e41-9d86-4051-a058-253b389103e0 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.172399 May 16 19:15:03.819875 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 500/1034] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:15:03 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:15:04.056220 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-02856fb7-231e-4bea-8aec-740eb322fcba tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:04.057164 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-02856fb7-231e-4bea-8aec-740eb322fcba tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:04.072252 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-02856fb7-231e-4bea-8aec-740eb322fcba tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:04.072252 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-02856fb7-231e-4bea-8aec-740eb322fcba tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:04.072252 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-02856fb7-231e-4bea-8aec-740eb322fcba tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:04.072252 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-02856fb7-231e-4bea-8aec-740eb322fcba tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:04.089841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d1fbf14b-f18e-4e3c-802c-e678c43e3616 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:04.090465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d1fbf14b-f18e-4e3c-802c-e678c43e3616 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:04.097153 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1fbf14b-f18e-4e3c-802c-e678c43e3616 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:04.097724 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1fbf14b-f18e-4e3c-802c-e678c43e3616 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:04.098664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1fbf14b-f18e-4e3c-802c-e678c43e3616 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:04.099177 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d1fbf14b-f18e-4e3c-802c-e678c43e3616 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:04.205860 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-02856fb7-231e-4bea-8aec-740eb322fcba tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:04.214341 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-02856fb7-231e-4bea-8aec-740eb322fcba tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.162178 May 16 19:15:04.214938 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 535/1035] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:04 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:04.239897 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d1fbf14b-f18e-4e3c-802c-e678c43e3616 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:04.249483 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d1fbf14b-f18e-4e3c-802c-e678c43e3616 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1671 microversion: 2.1 time: 0.163549 May 16 19:15:04.250098 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 501/1036] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:04 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:15:04.837988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-01177aac-1460-4843-9433-fd02c71c6048 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:04.838599 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-01177aac-1460-4843-9433-fd02c71c6048 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:04.844664 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-01177aac-1460-4843-9433-fd02c71c6048 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:04.845118 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-01177aac-1460-4843-9433-fd02c71c6048 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:04.845926 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-01177aac-1460-4843-9433-fd02c71c6048 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:04.846360 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-01177aac-1460-4843-9433-fd02c71c6048 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:04.984629 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-01177aac-1460-4843-9433-fd02c71c6048 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:04.992510 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-01177aac-1460-4843-9433-fd02c71c6048 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:04.994075 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-01177aac-1460-4843-9433-fd02c71c6048 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:04.995257 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-01177aac-1460-4843-9433-fd02c71c6048 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.161396 May 16 19:15:04.995825 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 536/1037] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:15:04 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:15:05.131157 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-66fffbd8-0e44-4f89-a274-93c84b70eb23 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6147ed60-2b53-41a6-b81e-1bfe56dd2771"}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:15:05.131157 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-66fffbd8-0e44-4f89-a274-93c84b70eb23 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:05.137717 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-66fffbd8-0e44-4f89-a274-93c84b70eb23 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:05.138165 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-66fffbd8-0e44-4f89-a274-93c84b70eb23 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:05.138940 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-66fffbd8-0e44-4f89-a274-93c84b70eb23 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:05.139368 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-66fffbd8-0e44-4f89-a274-93c84b70eb23 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:05.232165 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d2cf92fe-3794-479f-9714-f1e0afee32a4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:05.232827 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d2cf92fe-3794-479f-9714-f1e0afee32a4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:05.239450 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d2cf92fe-3794-479f-9714-f1e0afee32a4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:05.239913 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d2cf92fe-3794-479f-9714-f1e0afee32a4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:05.240688 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d2cf92fe-3794-479f-9714-f1e0afee32a4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:05.241128 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d2cf92fe-3794-479f-9714-f1e0afee32a4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:05.371777 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d2cf92fe-3794-479f-9714-f1e0afee32a4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:05.379425 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d2cf92fe-3794-479f-9714-f1e0afee32a4 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.151196 May 16 19:15:05.380002 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 537/1038] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:05 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:05.384552 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0463c640-7f45-4005-8c4a-c2eee43b69f0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:05.385153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0463c640-7f45-4005-8c4a-c2eee43b69f0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:05.391048 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0463c640-7f45-4005-8c4a-c2eee43b69f0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:05.391474 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0463c640-7f45-4005-8c4a-c2eee43b69f0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:05.392616 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0463c640-7f45-4005-8c4a-c2eee43b69f0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:05.393043 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0463c640-7f45-4005-8c4a-c2eee43b69f0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:05.540196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0463c640-7f45-4005-8c4a-c2eee43b69f0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:05.549798 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0463c640-7f45-4005-8c4a-c2eee43b69f0 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1671 microversion: 2.1 time: 0.168649 May 16 19:15:05.550438 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 538/1039] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:05 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:05.880124 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-66fffbd8-0e44-4f89-a274-93c84b70eb23 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "POST /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.754655 May 16 19:15:05.881468 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 502/1040] 10.222.0.24 () {60 vars in 1322 bytes} [Mon May 16 19:15:05 2022] POST /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd/os-volume_attachments => generated 194 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:15:06.013941 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-71aacbe6-05cb-40fa-b0b5-e3ffbc3d0d2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:06.014624 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-71aacbe6-05cb-40fa-b0b5-e3ffbc3d0d2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:06.021226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-71aacbe6-05cb-40fa-b0b5-e3ffbc3d0d2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:06.021729 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-71aacbe6-05cb-40fa-b0b5-e3ffbc3d0d2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:06.022582 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-71aacbe6-05cb-40fa-b0b5-e3ffbc3d0d2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:06.023082 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-71aacbe6-05cb-40fa-b0b5-e3ffbc3d0d2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:06.163146 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-71aacbe6-05cb-40fa-b0b5-e3ffbc3d0d2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:06.172056 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-71aacbe6-05cb-40fa-b0b5-e3ffbc3d0d2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:06.174015 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-71aacbe6-05cb-40fa-b0b5-e3ffbc3d0d2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:06.175567 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-71aacbe6-05cb-40fa-b0b5-e3ffbc3d0d2c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.165505 May 16 19:15:06.186587 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 539/1041] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:15:06 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:15:06.397991 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-144e3a90-9c49-4798-81b3-4bef217000d6 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:06.398641 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-144e3a90-9c49-4798-81b3-4bef217000d6 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:06.405386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-144e3a90-9c49-4798-81b3-4bef217000d6 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:06.405888 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-144e3a90-9c49-4798-81b3-4bef217000d6 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:06.406620 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-144e3a90-9c49-4798-81b3-4bef217000d6 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:06.407056 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-144e3a90-9c49-4798-81b3-4bef217000d6 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:06.567647 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c97af789-f787-42c9-999b-3a4dedfbd997 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:06.568683 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c97af789-f787-42c9-999b-3a4dedfbd997 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:06.577912 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c97af789-f787-42c9-999b-3a4dedfbd997 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:06.578572 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c97af789-f787-42c9-999b-3a4dedfbd997 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:06.579446 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c97af789-f787-42c9-999b-3a4dedfbd997 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:06.579997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c97af789-f787-42c9-999b-3a4dedfbd997 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:06.649630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c97af789-f787-42c9-999b-3a4dedfbd997 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d2aea046214bfcbbe6d5b3581fc155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee1963e977f4ac7b6d1877a6dd740a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:06.660455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c97af789-f787-42c9-999b-3a4dedfbd997 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 200 len: 1603 microversion: 2.1 time: 0.097046 May 16 19:15:06.661435 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 540/1042] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:06 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 1603 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:15:06.793020 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-765e5e36-678a-4017-9040-af377e392ed2 req-4d8ec5a1-2e59-4316-8346-55d61acbe307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec122f45-8f35-47df-85df-f54da6781402", "name": "network-vif-deleted", "tag": "682e565b-db4b-4d5d-847e-10679093da8c"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:15:06.807611 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-765e5e36-678a-4017-9040-af377e392ed2 req-4d8ec5a1-2e59-4316-8346-55d61acbe307 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:06.809147 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-144e3a90-9c49-4798-81b3-4bef217000d6 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:06.811640 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-765e5e36-678a-4017-9040-af377e392ed2 req-4d8ec5a1-2e59-4316-8346-55d61acbe307 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:06.824756 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-144e3a90-9c49-4798-81b3-4bef217000d6 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.431398 May 16 19:15:06.825904 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 503/1043] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:06 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:06.832955 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-765e5e36-678a-4017-9040-af377e392ed2 req-4d8ec5a1-2e59-4316-8346-55d61acbe307 service nova] Creating event network-vif-deleted:682e565b-db4b-4d5d-847e-10679093da8c for instance ec122f45-8f35-47df-85df-f54da6781402 on hv-cinder-76606 May 16 19:15:06.839197 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-765e5e36-678a-4017-9040-af377e392ed2 req-4d8ec5a1-2e59-4316-8346-55d61acbe307 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049696 May 16 19:15:06.840516 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 541/1044] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:15:07.194158 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b1e99285-701d-48b0-9eea-a0346e36c01b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:07.194776 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b1e99285-701d-48b0-9eea-a0346e36c01b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:07.201124 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b1e99285-701d-48b0-9eea-a0346e36c01b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:07.201569 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b1e99285-701d-48b0-9eea-a0346e36c01b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:07.202387 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b1e99285-701d-48b0-9eea-a0346e36c01b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:07.202823 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b1e99285-701d-48b0-9eea-a0346e36c01b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:07.335086 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b1e99285-701d-48b0-9eea-a0346e36c01b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:07.343617 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b1e99285-701d-48b0-9eea-a0346e36c01b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:07.345115 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b1e99285-701d-48b0-9eea-a0346e36c01b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:07.346343 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b1e99285-701d-48b0-9eea-a0346e36c01b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.156342 May 16 19:15:07.346918 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 504/1045] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:15:07 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:15:07.678670 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2b8d704a-4d98-421b-92e9-4fcd114c9ad8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:07.679372 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2b8d704a-4d98-421b-92e9-4fcd114c9ad8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:07.685472 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2b8d704a-4d98-421b-92e9-4fcd114c9ad8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:07.685951 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2b8d704a-4d98-421b-92e9-4fcd114c9ad8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:07.686723 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2b8d704a-4d98-421b-92e9-4fcd114c9ad8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:07.687157 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2b8d704a-4d98-421b-92e9-4fcd114c9ad8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:07.700333 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-2b8d704a-4d98-421b-92e9-4fcd114c9ad8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] HTTP exception thrown: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2b8d704a-4d98-421b-92e9-4fcd114c9ad8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Request method failure captured: May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 HTTP/1.1 May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqEZT6mTo_UphwI-EfWeAkahjxL1N0So-0jfzNSPYzjEpUMPTGhnIis0D_rwIe2FEGmyrwMMK9eYEBibQ_bcX4zwG9OoHY5E_Se69-u9zYer_gQQbFt5rZXRE17-C2ehMmwYw-JcTsVqxaArPwAtqZlbknUg_4KIa5nmydhc60e9-8U May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: dee1963e977f4ac7b6d1877a6dd740a9 May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-AttachVolumeTestJSON-1533894289 May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:15:07.702142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:15:07.703747 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:15:07.703747 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-AttachVolumeTestJSON-1533894289 May 16 19:15:07.703747 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: dee1963e977f4ac7b6d1877a6dd740a9 May 16 19:15:07.703747 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1533894289 May 16 19:15:07.703747 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-AttachVolumeTestJSON-1533894289-project May 16 19:15:07.703747 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:15:07.703747 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:15:07.703747 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: a7d2aea046214bfcbbe6d5b3581fc155 May 16 19:15:07.703747 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-AttachVolumeTestJSON-1533894289-project May 16 19:15:07.703747 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:15:07.703747 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. May 16 19:15:07.703747 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': 'ec122f45-8f35-47df-85df-f54da6781402'} May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:15:07.704617 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. May 16 19:15:07.706132 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:07.707413 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2b8d704a-4d98-421b-92e9-4fcd114c9ad8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Returning 404 to user: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:15:07.707413 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2b8d704a-4d98-421b-92e9-4fcd114c9ad8 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 404 len: 111 microversion: 2.1 time: 0.029703 May 16 19:15:07.707413 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 542/1046] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:07 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:15:07.712865 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-804dd614-f547-460e-99c8-1855573e617a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '.version_select at 0x7f1e0be29790>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:07.731223 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-804dd614-f547-460e-99c8-1855573e617a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-943070771" status: 202 len: 0 microversion: 2.1 time: 0.022312 May 16 19:15:07.731903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 505/1047] 10.222.0.24 () {58 vars in 1217 bytes} [Mon May 16 19:15:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-943070771 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:15:07.842581 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ac633bcf-fe0d-4000-9c64-7f5223d9e637 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:07.843199 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ac633bcf-fe0d-4000-9c64-7f5223d9e637 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:07.849719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ac633bcf-fe0d-4000-9c64-7f5223d9e637 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:07.850135 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ac633bcf-fe0d-4000-9c64-7f5223d9e637 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:07.850925 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ac633bcf-fe0d-4000-9c64-7f5223d9e637 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:07.851351 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ac633bcf-fe0d-4000-9c64-7f5223d9e637 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:08.083588 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ac633bcf-fe0d-4000-9c64-7f5223d9e637 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:08.092295 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ac633bcf-fe0d-4000-9c64-7f5223d9e637 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.253730 May 16 19:15:08.093177 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 543/1048] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:07 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:08.366923 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ab9642b9-01c1-45f4-a7bd-6a6db28d6f1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:08.368121 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ab9642b9-01c1-45f4-a7bd-6a6db28d6f1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:08.376183 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ab9642b9-01c1-45f4-a7bd-6a6db28d6f1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:08.377067 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ab9642b9-01c1-45f4-a7bd-6a6db28d6f1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:08.379799 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ab9642b9-01c1-45f4-a7bd-6a6db28d6f1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:08.380905 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ab9642b9-01c1-45f4-a7bd-6a6db28d6f1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:08.702403 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ab9642b9-01c1-45f4-a7bd-6a6db28d6f1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:08.710912 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ab9642b9-01c1-45f4-a7bd-6a6db28d6f1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:08.712532 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ab9642b9-01c1-45f4-a7bd-6a6db28d6f1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:08.714151 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ab9642b9-01c1-45f4-a7bd-6a6db28d6f1b tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.353297 May 16 19:15:08.725454 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 506/1049] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:15:08 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:15:09.110165 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d9f04873-aa29-4fe2-9469-9c8d8c2f3f6f tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:09.110777 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d9f04873-aa29-4fe2-9469-9c8d8c2f3f6f tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:09.117441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d9f04873-aa29-4fe2-9469-9c8d8c2f3f6f tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:09.117928 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d9f04873-aa29-4fe2-9469-9c8d8c2f3f6f tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:09.118717 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d9f04873-aa29-4fe2-9469-9c8d8c2f3f6f tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:09.119142 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-d9f04873-aa29-4fe2-9469-9c8d8c2f3f6f tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:09.259210 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d9f04873-aa29-4fe2-9469-9c8d8c2f3f6f tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:09.267525 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d9f04873-aa29-4fe2-9469-9c8d8c2f3f6f tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.161382 May 16 19:15:09.268037 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 544/1050] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:09 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:09.732687 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e3f0dec5-2959-4983-bc0b-8dec1a1b7a65 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:09.733313 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e3f0dec5-2959-4983-bc0b-8dec1a1b7a65 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:09.740760 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-81612a63-1f7a-4f8b-8b97-31bb932459b8 req-c7d79ab8-0ce0-41e8-8801-0004b1f42860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b664a08c-f97e-4c52-b849-9eddb2e65be5", "name": "network-vif-plugged", "status": "completed", "tag": "34940ecb-c2a4-45ca-ad50-7ea9f112b22a"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:15:09.742338 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e3f0dec5-2959-4983-bc0b-8dec1a1b7a65 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:09.742788 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e3f0dec5-2959-4983-bc0b-8dec1a1b7a65 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:09.746675 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e3f0dec5-2959-4983-bc0b-8dec1a1b7a65 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:09.747697 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e3f0dec5-2959-4983-bc0b-8dec1a1b7a65 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:09.754515 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-81612a63-1f7a-4f8b-8b97-31bb932459b8 req-c7d79ab8-0ce0-41e8-8801-0004b1f42860 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:09.754995 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-81612a63-1f7a-4f8b-8b97-31bb932459b8 req-c7d79ab8-0ce0-41e8-8801-0004b1f42860 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:09.780640 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-81612a63-1f7a-4f8b-8b97-31bb932459b8 req-c7d79ab8-0ce0-41e8-8801-0004b1f42860 service nova] Creating event network-vif-plugged:34940ecb-c2a4-45ca-ad50-7ea9f112b22a for instance b664a08c-f97e-4c52-b849-9eddb2e65be5 on hv-cinder-76606 May 16 19:15:09.787681 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-81612a63-1f7a-4f8b-8b97-31bb932459b8 req-c7d79ab8-0ce0-41e8-8801-0004b1f42860 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052320 May 16 19:15:09.788279 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 545/1051] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:15:09.904123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e3f0dec5-2959-4983-bc0b-8dec1a1b7a65 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:09.914949 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e3f0dec5-2959-4983-bc0b-8dec1a1b7a65 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:09.918113 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e3f0dec5-2959-4983-bc0b-8dec1a1b7a65 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:09.919492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e3f0dec5-2959-4983-bc0b-8dec1a1b7a65 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.190721 May 16 19:15:09.920630 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 507/1052] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:15:09 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:15:10.288651 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4de80405-01a5-41fd-8aa6-73aa15d1220c tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:10.290325 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-4de80405-01a5-41fd-8aa6-73aa15d1220c tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:10.301679 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4de80405-01a5-41fd-8aa6-73aa15d1220c tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:10.302427 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4de80405-01a5-41fd-8aa6-73aa15d1220c tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:10.303757 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4de80405-01a5-41fd-8aa6-73aa15d1220c tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:10.304484 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4de80405-01a5-41fd-8aa6-73aa15d1220c tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:10.456169 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4de80405-01a5-41fd-8aa6-73aa15d1220c tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:10.464112 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4de80405-01a5-41fd-8aa6-73aa15d1220c tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.182656 May 16 19:15:10.464683 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 546/1053] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:10 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:10.938456 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-a6117e39-8824-487c-a46d-8536e980096c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:10.938928 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-a6117e39-8824-487c-a46d-8536e980096c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:10.949364 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a6117e39-8824-487c-a46d-8536e980096c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:10.949987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a6117e39-8824-487c-a46d-8536e980096c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:10.950884 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a6117e39-8824-487c-a46d-8536e980096c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:10.951411 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a6117e39-8824-487c-a46d-8536e980096c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:10.986610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-1bb34057-f961-4039-8663-df1067f6ff2c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:10.987290 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-1bb34057-f961-4039-8663-df1067f6ff2c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:10.996363 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1bb34057-f961-4039-8663-df1067f6ff2c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:10.996893 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1bb34057-f961-4039-8663-df1067f6ff2c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:11.001619 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1bb34057-f961-4039-8663-df1067f6ff2c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:11.001619 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1bb34057-f961-4039-8663-df1067f6ff2c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:11.016166 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-1bb34057-f961-4039-8663-df1067f6ff2c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] HTTP exception thrown: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-1bb34057-f961-4039-8663-df1067f6ff2c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Request method failure captured: May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: DELETE /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 HTTP/1.1 May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqEZT6mTo_UphwI-EfWeAkahjxL1N0So-0jfzNSPYzjEpUMPTGhnIis0D_rwIe2FEGmyrwMMK9eYEBibQ_bcX4zwG9OoHY5E_Se69-u9zYer_gQQbFt5rZXRE17-C2ehMmwYw-JcTsVqxaArPwAtqZlbknUg_4KIa5nmydhc60e9-8U May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: dee1963e977f4ac7b6d1877a6dd740a9 May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-AttachVolumeTestJSON-1533894289 May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:15:11.018441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:15:11.019826 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:15:11.019826 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-AttachVolumeTestJSON-1533894289 May 16 19:15:11.019826 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: dee1963e977f4ac7b6d1877a6dd740a9 May 16 19:15:11.019826 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1533894289 May 16 19:15:11.019826 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-AttachVolumeTestJSON-1533894289-project May 16 19:15:11.019826 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:15:11.019826 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:15:11.019826 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: a7d2aea046214bfcbbe6d5b3581fc155 May 16 19:15:11.019826 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-AttachVolumeTestJSON-1533894289-project May 16 19:15:11.019826 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:15:11.019826 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. May 16 19:15:11.019826 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': 'ec122f45-8f35-47df-85df-f54da6781402'} May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:15:11.020643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. May 16 19:15:11.021931 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:11.023178 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-1bb34057-f961-4039-8663-df1067f6ff2c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Returning 404 to user: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:15:11.023178 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-1bb34057-f961-4039-8663-df1067f6ff2c tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "DELETE /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 404 len: 111 microversion: 2.1 time: 0.037606 May 16 19:15:11.023178 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 547/1054] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:15:10 2022] DELETE /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:15:11.029991 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-61eb31b5-4674-4300-98db-c4f166b4ad3a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:11.030784 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-61eb31b5-4674-4300-98db-c4f166b4ad3a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: ec122f45-8f35-47df-85df-f54da6781402] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:11.038622 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-61eb31b5-4674-4300-98db-c4f166b4ad3a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:11.039575 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-61eb31b5-4674-4300-98db-c4f166b4ad3a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:11.040479 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-61eb31b5-4674-4300-98db-c4f166b4ad3a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:11.041095 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-61eb31b5-4674-4300-98db-c4f166b4ad3a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:11.055711 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-61eb31b5-4674-4300-98db-c4f166b4ad3a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] HTTP exception thrown: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-61eb31b5-4674-4300-98db-c4f166b4ad3a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Request method failure captured: May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 HTTP/1.1 May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqEZT6mTo_UphwI-EfWeAkahjxL1N0So-0jfzNSPYzjEpUMPTGhnIis0D_rwIe2FEGmyrwMMK9eYEBibQ_bcX4zwG9OoHY5E_Se69-u9zYer_gQQbFt5rZXRE17-C2ehMmwYw-JcTsVqxaArPwAtqZlbknUg_4KIa5nmydhc60e9-8U May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: dee1963e977f4ac7b6d1877a6dd740a9 May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-AttachVolumeTestJSON-1533894289 May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:15:11.057631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:15:11.059249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:15:11.059249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-AttachVolumeTestJSON-1533894289 May 16 19:15:11.059249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: dee1963e977f4ac7b6d1877a6dd740a9 May 16 19:15:11.059249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1533894289 May 16 19:15:11.059249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-AttachVolumeTestJSON-1533894289-project May 16 19:15:11.059249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:15:11.059249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:15:11.059249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: a7d2aea046214bfcbbe6d5b3581fc155 May 16 19:15:11.059249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-AttachVolumeTestJSON-1533894289-project May 16 19:15:11.059249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:15:11.059249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. May 16 19:15:11.059249 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': 'ec122f45-8f35-47df-85df-f54da6781402'} May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:15:11.060143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. May 16 19:15:11.061719 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:11.066861 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-61eb31b5-4674-4300-98db-c4f166b4ad3a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Returning 404 to user: Instance ec122f45-8f35-47df-85df-f54da6781402 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:15:11.066861 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-61eb31b5-4674-4300-98db-c4f166b4ad3a tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402" status: 404 len: 111 microversion: 2.1 time: 0.035835 May 16 19:15:11.066861 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 548/1055] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:11 2022] GET /compute/v2.1/servers/ec122f45-8f35-47df-85df-f54da6781402 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:15:11.101036 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-a6117e39-8824-487c-a46d-8536e980096c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:11.110658 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-a6117e39-8824-487c-a46d-8536e980096c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:11.113212 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-a6117e39-8824-487c-a46d-8536e980096c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:11.114604 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-a6117e39-8824-487c-a46d-8536e980096c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.180533 May 16 19:15:11.115337 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 508/1056] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:15:10 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:15:11.481997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7a568faa-796c-491f-8532-0fc9bbe70bd9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:11.483671 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7a568faa-796c-491f-8532-0fc9bbe70bd9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:11.491205 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7a568faa-796c-491f-8532-0fc9bbe70bd9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:11.491890 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7a568faa-796c-491f-8532-0fc9bbe70bd9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:11.492988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7a568faa-796c-491f-8532-0fc9bbe70bd9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:11.493999 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7a568faa-796c-491f-8532-0fc9bbe70bd9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:11.632888 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7a568faa-796c-491f-8532-0fc9bbe70bd9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:11.641128 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7a568faa-796c-491f-8532-0fc9bbe70bd9 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.163851 May 16 19:15:11.644032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 549/1057] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:11 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:12.134713 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-db8a6f8b-46d6-4638-951e-0b7b34d9059c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:12.135342 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-db8a6f8b-46d6-4638-951e-0b7b34d9059c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:12.142619 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-db8a6f8b-46d6-4638-951e-0b7b34d9059c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:12.143068 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-db8a6f8b-46d6-4638-951e-0b7b34d9059c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:12.143891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-db8a6f8b-46d6-4638-951e-0b7b34d9059c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:12.144317 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-db8a6f8b-46d6-4638-951e-0b7b34d9059c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:12.204709 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ccef6326-9e90-4d7d-9950-d296df60e1ad tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:12.205203 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ccef6326-9e90-4d7d-9950-d296df60e1ad tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:12.211998 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ccef6326-9e90-4d7d-9950-d296df60e1ad tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:12.212441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ccef6326-9e90-4d7d-9950-d296df60e1ad tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:12.213174 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ccef6326-9e90-4d7d-9950-d296df60e1ad tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:12.213707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ccef6326-9e90-4d7d-9950-d296df60e1ad tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:12.227339 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-ccef6326-9e90-4d7d-9950-d296df60e1ad tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] HTTP exception thrown: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ccef6326-9e90-4d7d-9950-d296df60e1ad tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Request method failure captured: May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: DELETE /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 HTTP/1.1 May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqEZT6mTo_UphwI-EfWeAkahjxL1N0So-0jfzNSPYzjEpUMPTGhnIis0D_rwIe2FEGmyrwMMK9eYEBibQ_bcX4zwG9OoHY5E_Se69-u9zYer_gQQbFt5rZXRE17-C2ehMmwYw-JcTsVqxaArPwAtqZlbknUg_4KIa5nmydhc60e9-8U May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: dee1963e977f4ac7b6d1877a6dd740a9 May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-AttachVolumeTestJSON-1533894289 May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:15:12.228936 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:15:12.230630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:15:12.230630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-AttachVolumeTestJSON-1533894289 May 16 19:15:12.230630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: dee1963e977f4ac7b6d1877a6dd740a9 May 16 19:15:12.230630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1533894289 May 16 19:15:12.230630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-AttachVolumeTestJSON-1533894289-project May 16 19:15:12.230630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:15:12.230630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:15:12.230630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: a7d2aea046214bfcbbe6d5b3581fc155 May 16 19:15:12.230630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-AttachVolumeTestJSON-1533894289-project May 16 19:15:12.230630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:15:12.230630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. May 16 19:15:12.230630 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': 'a68fcd6b-1593-4fd4-8915-3153f52105c1'} May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:15:12.231560 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. May 16 19:15:12.233032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:12.234971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ccef6326-9e90-4d7d-9950-d296df60e1ad tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Returning 404 to user: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:15:12.234971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ccef6326-9e90-4d7d-9950-d296df60e1ad tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 404 len: 111 microversion: 2.1 time: 0.029898 May 16 19:15:12.234971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 550/1058] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:15:12 2022] DELETE /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:15:12.238767 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5e03e20c-da60-4176-b74f-1526979fab83 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:12.239368 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5e03e20c-da60-4176-b74f-1526979fab83 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] [instance: a68fcd6b-1593-4fd4-8915-3153f52105c1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:12.245440 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5e03e20c-da60-4176-b74f-1526979fab83 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:12.245892 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5e03e20c-da60-4176-b74f-1526979fab83 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:12.246677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5e03e20c-da60-4176-b74f-1526979fab83 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:12.247114 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5e03e20c-da60-4176-b74f-1526979fab83 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:12.260869 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-5e03e20c-da60-4176-b74f-1526979fab83 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] HTTP exception thrown: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5e03e20c-da60-4176-b74f-1526979fab83 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Request method failure captured: May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 HTTP/1.1 May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqEZT6mTo_UphwI-EfWeAkahjxL1N0So-0jfzNSPYzjEpUMPTGhnIis0D_rwIe2FEGmyrwMMK9eYEBibQ_bcX4zwG9OoHY5E_Se69-u9zYer_gQQbFt5rZXRE17-C2ehMmwYw-JcTsVqxaArPwAtqZlbknUg_4KIa5nmydhc60e9-8U May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: dee1963e977f4ac7b6d1877a6dd740a9 May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-AttachVolumeTestJSON-1533894289 May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:15:12.262455 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:15:12.264071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dee1963e977f4ac7b6d1877a6dd740a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:15:12.264071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-AttachVolumeTestJSON-1533894289 May 16 19:15:12.264071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: dee1963e977f4ac7b6d1877a6dd740a9 May 16 19:15:12.264071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1533894289 May 16 19:15:12.264071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-AttachVolumeTestJSON-1533894289-project May 16 19:15:12.264071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:15:12.264071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:15:12.264071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: a7d2aea046214bfcbbe6d5b3581fc155 May 16 19:15:12.264071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-AttachVolumeTestJSON-1533894289-project May 16 19:15:12.264071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:15:12.264071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. May 16 19:15:12.264071 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': 'a68fcd6b-1593-4fd4-8915-3153f52105c1'} May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:15:12.264930 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. May 16 19:15:12.266487 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:12.268138 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5e03e20c-da60-4176-b74f-1526979fab83 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] Returning 404 to user: Instance a68fcd6b-1593-4fd4-8915-3153f52105c1 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:15:12.268138 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-5e03e20c-da60-4176-b74f-1526979fab83 tempest-AttachVolumeTestJSON-1533894289 tempest-AttachVolumeTestJSON-1533894289-project] 10.222.0.24 "GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1" status: 404 len: 111 microversion: 2.1 time: 0.028702 May 16 19:15:12.268138 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 551/1059] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:12 2022] GET /compute/v2.1/servers/a68fcd6b-1593-4fd4-8915-3153f52105c1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:15:12.284257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-db8a6f8b-46d6-4638-951e-0b7b34d9059c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:12.292737 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-db8a6f8b-46d6-4638-951e-0b7b34d9059c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:12.294259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-db8a6f8b-46d6-4638-951e-0b7b34d9059c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:12.295448 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-db8a6f8b-46d6-4638-951e-0b7b34d9059c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1731 microversion: 2.20 time: 0.165392 May 16 19:15:12.296446 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 509/1060] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:15:12 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:15:12.661983 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4c0cce83-4a1a-4d61-be0a-2781c42aed3b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:12.662589 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-4c0cce83-4a1a-4d61-be0a-2781c42aed3b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:12.669115 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4c0cce83-4a1a-4d61-be0a-2781c42aed3b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:12.669605 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4c0cce83-4a1a-4d61-be0a-2781c42aed3b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:12.670393 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4c0cce83-4a1a-4d61-be0a-2781c42aed3b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:12.670834 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-4c0cce83-4a1a-4d61-be0a-2781c42aed3b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:12.997237 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-4c0cce83-4a1a-4d61-be0a-2781c42aed3b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:13.007248 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4c0cce83-4a1a-4d61-be0a-2781c42aed3b tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.350617 May 16 19:15:13.007817 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 552/1061] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:12 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:13.313780 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f4e92c37-6dba-4b83-bae9-a5c6bbeba6a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:13.314373 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f4e92c37-6dba-4b83-bae9-a5c6bbeba6a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:13.321001 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f4e92c37-6dba-4b83-bae9-a5c6bbeba6a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:13.321700 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f4e92c37-6dba-4b83-bae9-a5c6bbeba6a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:13.322476 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f4e92c37-6dba-4b83-bae9-a5c6bbeba6a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:13.323071 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f4e92c37-6dba-4b83-bae9-a5c6bbeba6a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:13.505729 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f4e92c37-6dba-4b83-bae9-a5c6bbeba6a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:13.515167 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f4e92c37-6dba-4b83-bae9-a5c6bbeba6a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:13.517197 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-f4e92c37-6dba-4b83-bae9-a5c6bbeba6a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:13.518459 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f4e92c37-6dba-4b83-bae9-a5c6bbeba6a9 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1718 microversion: 2.20 time: 0.208910 May 16 19:15:13.523402 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 510/1062] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:15:13 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1718 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 19:15:13.561770 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7b182bda-210e-438d-8480-cbcc472e9f1a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:13.564619 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7b182bda-210e-438d-8480-cbcc472e9f1a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:13.570932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7b182bda-210e-438d-8480-cbcc472e9f1a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:13.571587 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7b182bda-210e-438d-8480-cbcc472e9f1a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:13.572554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7b182bda-210e-438d-8480-cbcc472e9f1a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:13.573143 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7b182bda-210e-438d-8480-cbcc472e9f1a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:13.661868 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-7b182bda-210e-438d-8480-cbcc472e9f1a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lazy-loading 'services' on Instance uuid a0498aab-f458-4907-8557-c094918d4cdd {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:15:13.770835 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7b182bda-210e-438d-8480-cbcc472e9f1a tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd/os-volume_attachments/6147ed60-2b53-41a6-b81e-1bfe56dd2771" status: 202 len: 0 microversion: 2.1 time: 0.213021 May 16 19:15:13.774674 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 553/1063] 10.222.0.24 () {58 vars in 1415 bytes} [Mon May 16 19:15:13 2022] DELETE /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd/os-volume_attachments/6147ed60-2b53-41a6-b81e-1bfe56dd2771 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:15:13.780648 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-81d44b75-91d5-4c33-aa93-34d2cf4676ef tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:13.781793 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-81d44b75-91d5-4c33-aa93-34d2cf4676ef tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:13.788532 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-81d44b75-91d5-4c33-aa93-34d2cf4676ef tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:13.789329 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-81d44b75-91d5-4c33-aa93-34d2cf4676ef tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:13.790413 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-81d44b75-91d5-4c33-aa93-34d2cf4676ef tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:13.791076 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-81d44b75-91d5-4c33-aa93-34d2cf4676ef tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:13.829510 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-81d44b75-91d5-4c33-aa93-34d2cf4676ef tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053402 May 16 19:15:13.830808 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 511/1064] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:15:13 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:15:14.028282 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-5bc7c50c-fbf2-4356-834a-4a14a5ae82da tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:14.030130 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-5bc7c50c-fbf2-4356-834a-4a14a5ae82da tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:14.038817 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5bc7c50c-fbf2-4356-834a-4a14a5ae82da tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:14.039541 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5bc7c50c-fbf2-4356-834a-4a14a5ae82da tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:14.040539 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5bc7c50c-fbf2-4356-834a-4a14a5ae82da tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:14.041160 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-5bc7c50c-fbf2-4356-834a-4a14a5ae82da tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:14.248590 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-5bc7c50c-fbf2-4356-834a-4a14a5ae82da tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:14.256452 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-5bc7c50c-fbf2-4356-834a-4a14a5ae82da tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.235576 May 16 19:15:14.260876 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 554/1065] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:14 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:14.842175 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-087ee467-e586-498c-a5dd-ad0ebfc0d871 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:14.844271 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-087ee467-e586-498c-a5dd-ad0ebfc0d871 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:14.851472 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-087ee467-e586-498c-a5dd-ad0ebfc0d871 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:14.852206 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-087ee467-e586-498c-a5dd-ad0ebfc0d871 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:14.853141 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-087ee467-e586-498c-a5dd-ad0ebfc0d871 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:14.853747 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-087ee467-e586-498c-a5dd-ad0ebfc0d871 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:14.892827 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-087ee467-e586-498c-a5dd-ad0ebfc0d871 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054776 May 16 19:15:14.893414 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 512/1066] 10.222.0.24 () {58 vars in 1301 bytes} [Mon May 16 19:15:14 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 19:15:14.955294 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b5a01ca0-5355-4c1a-acf3-195f87f33d44 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:14.955835 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b5a01ca0-5355-4c1a-acf3-195f87f33d44 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:14.962694 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b5a01ca0-5355-4c1a-acf3-195f87f33d44 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:14.963300 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b5a01ca0-5355-4c1a-acf3-195f87f33d44 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:14.964233 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b5a01ca0-5355-4c1a-acf3-195f87f33d44 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:14.964700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b5a01ca0-5355-4c1a-acf3-195f87f33d44 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:14.992606 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b5a01ca0-5355-4c1a-acf3-195f87f33d44 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Going to try to terminate instance {{(pid=117274) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:15:15.074842 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b5a01ca0-5355-4c1a-acf3-195f87f33d44 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 204 len: 0 microversion: 2.1 time: 0.123222 May 16 19:15:15.075410 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 555/1067] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:15:14 2022] DELETE /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 19:15:15.083947 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-9545be0c-fcbb-43bc-9e35-c214d8f42e3c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:15.084564 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-9545be0c-fcbb-43bc-9e35-c214d8f42e3c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:15.090796 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9545be0c-fcbb-43bc-9e35-c214d8f42e3c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:15.091426 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9545be0c-fcbb-43bc-9e35-c214d8f42e3c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:15.092220 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9545be0c-fcbb-43bc-9e35-c214d8f42e3c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:15.092724 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-9545be0c-fcbb-43bc-9e35-c214d8f42e3c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:15.278244 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b80cb2ee-457b-4d07-82d9-e94152e5534e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:15.279035 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b80cb2ee-457b-4d07-82d9-e94152e5534e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:15.287933 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b80cb2ee-457b-4d07-82d9-e94152e5534e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:15.288385 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b80cb2ee-457b-4d07-82d9-e94152e5534e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:15.289186 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b80cb2ee-457b-4d07-82d9-e94152e5534e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:15.289692 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b80cb2ee-457b-4d07-82d9-e94152e5534e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:15.375792 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-9545be0c-fcbb-43bc-9e35-c214d8f42e3c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:15.385443 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-9545be0c-fcbb-43bc-9e35-c214d8f42e3c tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1681 microversion: 2.1 time: 0.305409 May 16 19:15:15.390220 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 513/1068] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:15 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1681 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:15.440043 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b80cb2ee-457b-4d07-82d9-e94152e5534e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:15.448256 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b80cb2ee-457b-4d07-82d9-e94152e5534e tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.174366 May 16 19:15:15.449059 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 556/1069] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:15 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:16.403395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-09fb1b81-2bdf-4f20-a4c9-4f508c041493 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:16.404859 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-09fb1b81-2bdf-4f20-a4c9-4f508c041493 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:16.411687 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-09fb1b81-2bdf-4f20-a4c9-4f508c041493 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:16.412229 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-09fb1b81-2bdf-4f20-a4c9-4f508c041493 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:16.413222 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-09fb1b81-2bdf-4f20-a4c9-4f508c041493 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:16.413676 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-09fb1b81-2bdf-4f20-a4c9-4f508c041493 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:16.465063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b73a4fef-c989-4799-bd60-5d23ca4c27ca tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:16.465848 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-b73a4fef-c989-4799-bd60-5d23ca4c27ca tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:16.472500 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b73a4fef-c989-4799-bd60-5d23ca4c27ca tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:16.473193 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b73a4fef-c989-4799-bd60-5d23ca4c27ca tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:16.474163 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b73a4fef-c989-4799-bd60-5d23ca4c27ca tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:16.474753 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-b73a4fef-c989-4799-bd60-5d23ca4c27ca tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:16.561786 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-09fb1b81-2bdf-4f20-a4c9-4f508c041493 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:16.569627 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-09fb1b81-2bdf-4f20-a4c9-4f508c041493 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1681 microversion: 2.1 time: 0.170032 May 16 19:15:16.570206 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 514/1070] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:16 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:16.637247 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-b73a4fef-c989-4799-bd60-5d23ca4c27ca tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:16.645775 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b73a4fef-c989-4799-bd60-5d23ca4c27ca tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.184729 May 16 19:15:16.646357 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 557/1071] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:16 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:17.576014 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-47c23925-25df-447c-ac7d-e7f97f80c132 req-4c9c2c22-6b26-4669-b12b-d2b81b578328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0498aab-f458-4907-8557-c094918d4cdd", "name": "network-vif-deleted", "tag": "ca17ae0a-1bb1-4979-a11b-bcee0aa3f50c"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:15:17.589984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-699533f3-b583-45f7-8186-fbc9df687927 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:17.590731 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-699533f3-b583-45f7-8186-fbc9df687927 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:17.593081 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-47c23925-25df-447c-ac7d-e7f97f80c132 req-4c9c2c22-6b26-4669-b12b-d2b81b578328 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:17.593605 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-47c23925-25df-447c-ac7d-e7f97f80c132 req-4c9c2c22-6b26-4669-b12b-d2b81b578328 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:17.602634 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-699533f3-b583-45f7-8186-fbc9df687927 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:17.603094 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-699533f3-b583-45f7-8186-fbc9df687927 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:17.604594 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-699533f3-b583-45f7-8186-fbc9df687927 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:17.605092 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-699533f3-b583-45f7-8186-fbc9df687927 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:17.624577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-47c23925-25df-447c-ac7d-e7f97f80c132 req-4c9c2c22-6b26-4669-b12b-d2b81b578328 service nova] Creating event network-vif-deleted:ca17ae0a-1bb1-4979-a11b-bcee0aa3f50c for instance a0498aab-f458-4907-8557-c094918d4cdd on hv-cinder-76606 May 16 19:15:17.664678 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-47c23925-25df-447c-ac7d-e7f97f80c132 req-4c9c2c22-6b26-4669-b12b-d2b81b578328 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087747 May 16 19:15:17.665366 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 515/1072] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:15:17.670787 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-a94f8c3a-1742-4cfc-a4b2-f03c92a112f7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:17.693597 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-a94f8c3a-1742-4cfc-a4b2-f03c92a112f7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:17.712168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a94f8c3a-1742-4cfc-a4b2-f03c92a112f7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:17.716950 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a94f8c3a-1742-4cfc-a4b2-f03c92a112f7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:17.718116 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a94f8c3a-1742-4cfc-a4b2-f03c92a112f7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:17.718719 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a94f8c3a-1742-4cfc-a4b2-f03c92a112f7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:17.782196 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-699533f3-b583-45f7-8186-fbc9df687927 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3af11e1ffc4ab1a37669f893d2f3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd195af6f92c42a18ed7051eae26dbaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:17.791995 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-699533f3-b583-45f7-8186-fbc9df687927 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 200 len: 1326 microversion: 2.1 time: 0.208488 May 16 19:15:17.793187 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 558/1073] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:17 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 1326 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:15:17.969454 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-a94f8c3a-1742-4cfc-a4b2-f03c92a112f7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:17.978397 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-a94f8c3a-1742-4cfc-a4b2-f03c92a112f7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.311755 May 16 19:15:17.978984 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 516/1074] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:17 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:18.158849 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-e6eea23d-271c-4419-98a9-f294793758e0 req-b42e8d47-aa76-4f6a-a383-496b371bb2ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a385b0-58f3-4946-b6c6-2cbd20fe387f", "name": "network-vif-plugged", "status": "completed", "tag": "aadd3356-5374-4e27-aec5-d1a129d4438b"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:15:18.172873 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-e6eea23d-271c-4419-98a9-f294793758e0 req-b42e8d47-aa76-4f6a-a383-496b371bb2ca service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:18.173357 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-e6eea23d-271c-4419-98a9-f294793758e0 req-b42e8d47-aa76-4f6a-a383-496b371bb2ca service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:18.192485 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-e6eea23d-271c-4419-98a9-f294793758e0 req-b42e8d47-aa76-4f6a-a383-496b371bb2ca service nova] Creating event network-vif-plugged:aadd3356-5374-4e27-aec5-d1a129d4438b for instance 96a385b0-58f3-4946-b6c6-2cbd20fe387f on hv-cinder-76606 May 16 19:15:18.206713 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-e6eea23d-271c-4419-98a9-f294793758e0 req-b42e8d47-aa76-4f6a-a383-496b371bb2ca service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051554 May 16 19:15:18.207756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 559/1075] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:15:18.809786 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e09397ce-08c1-4232-a914-e6c81bc26cbc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:18.810479 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e09397ce-08c1-4232-a914-e6c81bc26cbc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:18.817630 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e09397ce-08c1-4232-a914-e6c81bc26cbc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:18.818372 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e09397ce-08c1-4232-a914-e6c81bc26cbc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:18.829616 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e09397ce-08c1-4232-a914-e6c81bc26cbc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:18.830632 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e09397ce-08c1-4232-a914-e6c81bc26cbc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:18.846476 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-e09397ce-08c1-4232-a914-e6c81bc26cbc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] HTTP exception thrown: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e09397ce-08c1-4232-a914-e6c81bc26cbc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Request method failure captured: May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd HTTP/1.1 May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqEkfBgf-5XfH-1I-yuCRcEsCpbyBI1UoIvKz5FJMT4bGAMlNwLp0yu1A3yPkFIrpPBwb538SaogfPDVB6aYcwOKGjLO5ozfcqhZhnWzIyH6lLDvijCwB-q9kEmQJZsKm_pVPahD7yWMKKOQtIBayABLCJCDJpGvPEjaCIlQWvmenMs May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:15:18.848300 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:15:18.850093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:15:18.850093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:18.850093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:18.850093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:18.850093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:18.850093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:15:18.850093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:15:18.850093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 7d3af11e1ffc4ab1a37669f893d2f3be May 16 19:15:18.850093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:18.850093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:15:18.850093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. May 16 19:15:18.850093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': 'a0498aab-f458-4907-8557-c094918d4cdd'} May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:15:18.850913 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. May 16 19:15:18.852127 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:18.853198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e09397ce-08c1-4232-a914-e6c81bc26cbc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Returning 404 to user: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:15:18.853198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e09397ce-08c1-4232-a914-e6c81bc26cbc tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 404 len: 111 microversion: 2.1 time: 0.044836 May 16 19:15:18.853198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 517/1076] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:18 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:15:18.859909 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-618e4e9d-de47-4e46-9a31-22a7786bce69 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '.version_select at 0x7f1e186f0940>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:18.880990 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-618e4e9d-de47-4e46-9a31-22a7786bce69 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-614031191" status: 202 len: 0 microversion: 2.1 time: 0.025412 May 16 19:15:18.881612 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 560/1077] 10.222.0.24 () {58 vars in 1217 bytes} [Mon May 16 19:15:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-614031191 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:15:18.997627 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e0db5abb-fb8d-4199-8093-98b1f997a8fb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:18.998640 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e0db5abb-fb8d-4199-8093-98b1f997a8fb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:19.007132 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e0db5abb-fb8d-4199-8093-98b1f997a8fb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:19.007892 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e0db5abb-fb8d-4199-8093-98b1f997a8fb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:19.009437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e0db5abb-fb8d-4199-8093-98b1f997a8fb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:19.010175 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e0db5abb-fb8d-4199-8093-98b1f997a8fb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:19.222942 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e0db5abb-fb8d-4199-8093-98b1f997a8fb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:19.231956 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e0db5abb-fb8d-4199-8093-98b1f997a8fb tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1575 microversion: 2.1 time: 0.238852 May 16 19:15:19.232820 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 518/1078] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:18 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:20.251112 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-487b96a6-d011-4dcf-909a-0d473453f6f3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:20.251863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-487b96a6-d011-4dcf-909a-0d473453f6f3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:20.259816 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-487b96a6-d011-4dcf-909a-0d473453f6f3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:20.260274 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-487b96a6-d011-4dcf-909a-0d473453f6f3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:20.261594 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-487b96a6-d011-4dcf-909a-0d473453f6f3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:20.262374 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-487b96a6-d011-4dcf-909a-0d473453f6f3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:20.408101 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-487b96a6-d011-4dcf-909a-0d473453f6f3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:15:20.416638 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-487b96a6-d011-4dcf-909a-0d473453f6f3 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1562 microversion: 2.1 time: 0.171362 May 16 19:15:20.417262 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 561/1079] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:20 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:15:20.841390 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8856157a-d170-46bd-8420-52c6ca620e94 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:20.842160 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-8856157a-d170-46bd-8420-52c6ca620e94 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:20.852262 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8856157a-d170-46bd-8420-52c6ca620e94 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:20.852740 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8856157a-d170-46bd-8420-52c6ca620e94 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:20.853561 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8856157a-d170-46bd-8420-52c6ca620e94 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:20.854020 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-8856157a-d170-46bd-8420-52c6ca620e94 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:20.869391 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-8856157a-d170-46bd-8420-52c6ca620e94 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] HTTP exception thrown: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8856157a-d170-46bd-8420-52c6ca620e94 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Request method failure captured: May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: DELETE /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd HTTP/1.1 May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqEkfBgf-5XfH-1I-yuCRcEsCpbyBI1UoIvKz5FJMT4bGAMlNwLp0yu1A3yPkFIrpPBwb538SaogfPDVB6aYcwOKGjLO5ozfcqhZhnWzIyH6lLDvijCwB-q9kEmQJZsKm_pVPahD7yWMKKOQtIBayABLCJCDJpGvPEjaCIlQWvmenMs May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:15:20.870993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:15:20.872611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:15:20.872611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:20.872611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:20.872611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:20.872611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:20.872611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:15:20.872611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:15:20.872611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 7d3af11e1ffc4ab1a37669f893d2f3be May 16 19:15:20.872611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:20.872611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:15:20.872611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. May 16 19:15:20.872611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': 'a0498aab-f458-4907-8557-c094918d4cdd'} May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:15:20.873557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. May 16 19:15:20.875047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:20.877244 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-8856157a-d170-46bd-8420-52c6ca620e94 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Returning 404 to user: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:15:20.878145 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-8856157a-d170-46bd-8420-52c6ca620e94 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 404 len: 111 microversion: 2.1 time: 0.040895 May 16 19:15:20.878718 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 519/1080] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:15:20 2022] DELETE /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:15:20.891367 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0b2e9383-076f-4a00-94e9-7aa1f9f03490 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:20.891367 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0b2e9383-076f-4a00-94e9-7aa1f9f03490 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: a0498aab-f458-4907-8557-c094918d4cdd] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:20.897655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0b2e9383-076f-4a00-94e9-7aa1f9f03490 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:20.898170 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0b2e9383-076f-4a00-94e9-7aa1f9f03490 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:20.899086 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0b2e9383-076f-4a00-94e9-7aa1f9f03490 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:20.899579 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0b2e9383-076f-4a00-94e9-7aa1f9f03490 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:20.915577 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-0b2e9383-076f-4a00-94e9-7aa1f9f03490 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] HTTP exception thrown: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0b2e9383-076f-4a00-94e9-7aa1f9f03490 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Request method failure captured: May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd HTTP/1.1 May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqEkfBgf-5XfH-1I-yuCRcEsCpbyBI1UoIvKz5FJMT4bGAMlNwLp0yu1A3yPkFIrpPBwb538SaogfPDVB6aYcwOKGjLO5ozfcqhZhnWzIyH6lLDvijCwB-q9kEmQJZsKm_pVPahD7yWMKKOQtIBayABLCJCDJpGvPEjaCIlQWvmenMs May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:15:20.917359 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:15:20.918997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:15:20.918997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:20.918997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:20.918997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:20.918997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:20.918997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:15:20.918997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:15:20.918997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 7d3af11e1ffc4ab1a37669f893d2f3be May 16 19:15:20.918997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:20.918997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:15:20.918997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. May 16 19:15:20.918997 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': 'a0498aab-f458-4907-8557-c094918d4cdd'} May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:15:20.920011 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. May 16 19:15:20.921814 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:20.923189 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0b2e9383-076f-4a00-94e9-7aa1f9f03490 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Returning 404 to user: Instance a0498aab-f458-4907-8557-c094918d4cdd could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:15:20.923189 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0b2e9383-076f-4a00-94e9-7aa1f9f03490 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd" status: 404 len: 111 microversion: 2.1 time: 0.035556 May 16 19:15:20.923189 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 562/1081] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:20 2022] GET /compute/v2.1/servers/a0498aab-f458-4907-8557-c094918d4cdd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:15:22.061302 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4d025014-4e8a-4979-9e8f-f964006798b0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:22.061839 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-4d025014-4e8a-4979-9e8f-f964006798b0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:22.068474 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4d025014-4e8a-4979-9e8f-f964006798b0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:22.068993 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4d025014-4e8a-4979-9e8f-f964006798b0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:22.070069 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4d025014-4e8a-4979-9e8f-f964006798b0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:22.070494 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4d025014-4e8a-4979-9e8f-f964006798b0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:22.088001 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-4d025014-4e8a-4979-9e8f-f964006798b0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] HTTP exception thrown: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4d025014-4e8a-4979-9e8f-f964006798b0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Request method failure captured: May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: DELETE /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 HTTP/1.1 May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqEkfBgf-5XfH-1I-yuCRcEsCpbyBI1UoIvKz5FJMT4bGAMlNwLp0yu1A3yPkFIrpPBwb538SaogfPDVB6aYcwOKGjLO5ozfcqhZhnWzIyH6lLDvijCwB-q9kEmQJZsKm_pVPahD7yWMKKOQtIBayABLCJCDJpGvPEjaCIlQWvmenMs May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:15:22.089575 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:15:22.091216 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:15:22.091216 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:22.091216 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:22.091216 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:22.091216 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:22.091216 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:15:22.091216 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:15:22.091216 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 7d3af11e1ffc4ab1a37669f893d2f3be May 16 19:15:22.091216 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:22.091216 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:15:22.091216 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. May 16 19:15:22.091216 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': '7436d70f-ee98-42cc-95ff-4aa094d149c8'} May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:15:22.092488 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. May 16 19:15:22.093954 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:22.096171 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4d025014-4e8a-4979-9e8f-f964006798b0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Returning 404 to user: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:15:22.096171 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4d025014-4e8a-4979-9e8f-f964006798b0 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 404 len: 111 microversion: 2.1 time: 0.033649 May 16 19:15:22.096171 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 520/1082] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:15:22 2022] DELETE /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:15:22.100632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9ca567fc-b93e-4b28-80cc-f65dbaa971f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:22.100632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9ca567fc-b93e-4b28-80cc-f65dbaa971f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 7436d70f-ee98-42cc-95ff-4aa094d149c8] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:22.107017 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9ca567fc-b93e-4b28-80cc-f65dbaa971f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:22.107450 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9ca567fc-b93e-4b28-80cc-f65dbaa971f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:22.109743 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9ca567fc-b93e-4b28-80cc-f65dbaa971f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:22.109743 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9ca567fc-b93e-4b28-80cc-f65dbaa971f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:22.122903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-9ca567fc-b93e-4b28-80cc-f65dbaa971f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] HTTP exception thrown: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9ca567fc-b93e-4b28-80cc-f65dbaa971f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Request method failure captured: May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 HTTP/1.1 May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqEkfBgf-5XfH-1I-yuCRcEsCpbyBI1UoIvKz5FJMT4bGAMlNwLp0yu1A3yPkFIrpPBwb538SaogfPDVB6aYcwOKGjLO5ozfcqhZhnWzIyH6lLDvijCwB-q9kEmQJZsKm_pVPahD7yWMKKOQtIBayABLCJCDJpGvPEjaCIlQWvmenMs May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:15:22.124677 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:15:22.126243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:15:22.126243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:22.126243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:22.126243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:22.126243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:22.126243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:15:22.126243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:15:22.126243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 7d3af11e1ffc4ab1a37669f893d2f3be May 16 19:15:22.126243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:22.126243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:15:22.126243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. May 16 19:15:22.126243 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': '7436d70f-ee98-42cc-95ff-4aa094d149c8'} May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:15:22.127046 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. May 16 19:15:22.128907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:22.130685 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9ca567fc-b93e-4b28-80cc-f65dbaa971f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Returning 404 to user: Instance 7436d70f-ee98-42cc-95ff-4aa094d149c8 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:15:22.130685 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9ca567fc-b93e-4b28-80cc-f65dbaa971f1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8" status: 404 len: 111 microversion: 2.1 time: 0.030173 May 16 19:15:22.130685 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 563/1083] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:22 2022] GET /compute/v2.1/servers/7436d70f-ee98-42cc-95ff-4aa094d149c8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:15:22.135010 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-16e62177-1ad0-4dd8-91de-7fde0f11a2e1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:22.135506 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-16e62177-1ad0-4dd8-91de-7fde0f11a2e1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:22.142255 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-16e62177-1ad0-4dd8-91de-7fde0f11a2e1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:22.142776 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-16e62177-1ad0-4dd8-91de-7fde0f11a2e1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:22.143573 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-16e62177-1ad0-4dd8-91de-7fde0f11a2e1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:22.143974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-16e62177-1ad0-4dd8-91de-7fde0f11a2e1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:22.159259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-16e62177-1ad0-4dd8-91de-7fde0f11a2e1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] HTTP exception thrown: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-16e62177-1ad0-4dd8-91de-7fde0f11a2e1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Request method failure captured: May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: DELETE /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 HTTP/1.1 May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqEkfBgf-5XfH-1I-yuCRcEsCpbyBI1UoIvKz5FJMT4bGAMlNwLp0yu1A3yPkFIrpPBwb538SaogfPDVB6aYcwOKGjLO5ozfcqhZhnWzIyH6lLDvijCwB-q9kEmQJZsKm_pVPahD7yWMKKOQtIBayABLCJCDJpGvPEjaCIlQWvmenMs May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:15:22.160804 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:15:22.162272 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:15:22.162272 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:22.162272 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:22.162272 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:22.162272 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:22.162272 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:15:22.162272 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:15:22.162272 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 7d3af11e1ffc4ab1a37669f893d2f3be May 16 19:15:22.162272 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:22.162272 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:15:22.162272 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. May 16 19:15:22.162272 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': '73fbf87a-3557-408c-ac54-e6ca9017a0f1'} May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:15:22.163002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. May 16 19:15:22.164257 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:22.166755 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-16e62177-1ad0-4dd8-91de-7fde0f11a2e1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Returning 404 to user: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:15:22.167395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-16e62177-1ad0-4dd8-91de-7fde0f11a2e1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "DELETE /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 404 len: 111 microversion: 2.1 time: 0.036343 May 16 19:15:22.167969 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 521/1084] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:15:22 2022] DELETE /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:15:22.177644 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-bd40aaa2-e240-46f0-b46e-9ba0e8737cd1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:22.178265 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-bd40aaa2-e240-46f0-b46e-9ba0e8737cd1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 73fbf87a-3557-408c-ac54-e6ca9017a0f1] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:22.184726 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd40aaa2-e240-46f0-b46e-9ba0e8737cd1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:22.185226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd40aaa2-e240-46f0-b46e-9ba0e8737cd1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:22.186251 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd40aaa2-e240-46f0-b46e-9ba0e8737cd1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:22.186999 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bd40aaa2-e240-46f0-b46e-9ba0e8737cd1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:22.201001 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-bd40aaa2-e240-46f0-b46e-9ba0e8737cd1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] HTTP exception thrown: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-bd40aaa2-e240-46f0-b46e-9ba0e8737cd1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Request method failure captured: May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 HTTP/1.1 May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqEkfBgf-5XfH-1I-yuCRcEsCpbyBI1UoIvKz5FJMT4bGAMlNwLp0yu1A3yPkFIrpPBwb538SaogfPDVB6aYcwOKGjLO5ozfcqhZhnWzIyH6lLDvijCwB-q9kEmQJZsKm_pVPahD7yWMKKOQtIBayABLCJCDJpGvPEjaCIlQWvmenMs May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:15:22.202632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:15:22.204389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:15:22.204389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:22.204389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:22.204389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:22.204389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:22.204389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:15:22.204389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:15:22.204389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 7d3af11e1ffc4ab1a37669f893d2f3be May 16 19:15:22.204389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:22.204389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:15:22.204389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. May 16 19:15:22.204389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': '73fbf87a-3557-408c-ac54-e6ca9017a0f1'} May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:15:22.205707 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. May 16 19:15:22.209891 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:22.211354 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-bd40aaa2-e240-46f0-b46e-9ba0e8737cd1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Returning 404 to user: Instance 73fbf87a-3557-408c-ac54-e6ca9017a0f1 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:15:22.211354 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-bd40aaa2-e240-46f0-b46e-9ba0e8737cd1 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1" status: 404 len: 111 microversion: 2.1 time: 0.031842 May 16 19:15:22.211354 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 564/1085] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:22 2022] GET /compute/v2.1/servers/73fbf87a-3557-408c-ac54-e6ca9017a0f1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:15:23.348669 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-86bb1ee0-5035-4aa4-a2ff-0def12e37444 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:23.349392 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-86bb1ee0-5035-4aa4-a2ff-0def12e37444 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:23.356480 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-86bb1ee0-5035-4aa4-a2ff-0def12e37444 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:23.356731 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-86bb1ee0-5035-4aa4-a2ff-0def12e37444 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:23.357411 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-86bb1ee0-5035-4aa4-a2ff-0def12e37444 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:23.357882 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-86bb1ee0-5035-4aa4-a2ff-0def12e37444 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:23.371895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-86bb1ee0-5035-4aa4-a2ff-0def12e37444 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] HTTP exception thrown: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-86bb1ee0-5035-4aa4-a2ff-0def12e37444 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Request method failure captured: May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: DELETE /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 HTTP/1.1 May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqEkfBgf-5XfH-1I-yuCRcEsCpbyBI1UoIvKz5FJMT4bGAMlNwLp0yu1A3yPkFIrpPBwb538SaogfPDVB6aYcwOKGjLO5ozfcqhZhnWzIyH6lLDvijCwB-q9kEmQJZsKm_pVPahD7yWMKKOQtIBayABLCJCDJpGvPEjaCIlQWvmenMs May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:15:23.373432 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:15:23.376386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:15:23.376386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:23.376386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:23.376386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:23.376386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:23.376386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:15:23.376386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:15:23.376386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 7d3af11e1ffc4ab1a37669f893d2f3be May 16 19:15:23.376386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:23.376386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:15:23.376386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. May 16 19:15:23.376386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': '43ade137-6172-4f24-80ef-9e84b6fb6df7'} May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:15:23.378123 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. May 16 19:15:23.381645 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:23.385008 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-86bb1ee0-5035-4aa4-a2ff-0def12e37444 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Returning 404 to user: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:15:23.385008 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-86bb1ee0-5035-4aa4-a2ff-0def12e37444 tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "DELETE /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 404 len: 111 microversion: 2.1 time: 0.030175 May 16 19:15:23.385008 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 522/1086] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:15:23 2022] DELETE /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 19:15:23.385463 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-cfaeaf0c-f6e3-499a-8871-15d5d81b69cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:23.385463 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-cfaeaf0c-f6e3-499a-8871-15d5d81b69cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] [instance: 43ade137-6172-4f24-80ef-9e84b6fb6df7] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:15:23.391350 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cfaeaf0c-f6e3-499a-8871-15d5d81b69cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:23.392156 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cfaeaf0c-f6e3-499a-8871-15d5d81b69cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:23.392961 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cfaeaf0c-f6e3-499a-8871-15d5d81b69cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:15:23.393373 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-cfaeaf0c-f6e3-499a-8871-15d5d81b69cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:15:23.407406 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-cfaeaf0c-f6e3-499a-8871-15d5d81b69cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] HTTP exception thrown: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-cfaeaf0c-f6e3-499a-8871-15d5d81b69cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Request method failure captured: May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 HTTP/1.1 May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqEkfBgf-5XfH-1I-yuCRcEsCpbyBI1UoIvKz5FJMT4bGAMlNwLp0yu1A3yPkFIrpPBwb538SaogfPDVB6aYcwOKGjLO5ozfcqhZhnWzIyH6lLDvijCwB-q9kEmQJZsKm_pVPahD7yWMKKOQtIBayABLCJCDJpGvPEjaCIlQWvmenMs May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:15:23.409253 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:15:23.410921 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dd195af6f92c42a18ed7051eae26dbaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:15:23.410921 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:23.410921 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: dd195af6f92c42a18ed7051eae26dbaa May 16 19:15:23.410921 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1850707464 May 16 19:15:23.410921 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:23.410921 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:15:23.410921 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:15:23.410921 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 7d3af11e1ffc4ab1a37669f893d2f3be May 16 19:15:23.410921 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-AttachVolumeNegativeTest-1850707464-project May 16 19:15:23.410921 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:15:23.410921 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. May 16 19:15:23.410921 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': '43ade137-6172-4f24-80ef-9e84b6fb6df7'} May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:15:23.411695 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. May 16 19:15:23.412987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:15:23.414348 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-cfaeaf0c-f6e3-499a-8871-15d5d81b69cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] Returning 404 to user: Instance 43ade137-6172-4f24-80ef-9e84b6fb6df7 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:15:23.414348 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-cfaeaf0c-f6e3-499a-8871-15d5d81b69cd tempest-AttachVolumeNegativeTest-1850707464 tempest-AttachVolumeNegativeTest-1850707464-project] 10.222.0.24 "GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7" status: 404 len: 111 microversion: 2.1 time: 0.031092 May 16 19:15:23.414348 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 565/1087] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:15:23 2022] GET /compute/v2.1/servers/43ade137-6172-4f24-80ef-9e84b6fb6df7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:15:28.486998 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ca6d5089-d820-4536-b5cb-ddefff099711 tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] Action: 'create', calling method: .version_select at 0x7f1e0be1d820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-792300837", "metadata": {"Type": "work"}}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:15:28.771723 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ca6d5089-d820-4536-b5cb-ddefff099711 tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.401744 May 16 19:15:28.772650 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 523/1088] 10.222.0.24 () {60 vars in 1155 bytes} [Mon May 16 19:15:28 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 403 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 16 19:15:28.783893 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d11588f1-7a65-49d9-9a39-94eb7d4bf552 tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] Calling method '.version_select at 0x7f1e18fdbb80>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:28.835568 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d11588f1-7a65-49d9-9a39-94eb7d4bf552 tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/81f99811-98c3-4039-8efb-7cc0a9d02584" status: 200 len: 352 microversion: 2.1 time: 0.055526 May 16 19:15:28.836145 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 566/1089] 10.222.0.24 () {58 vars in 1244 bytes} [Mon May 16 19:15:28 2022] GET /compute/v2.1/os-volumes/81f99811-98c3-4039-8efb-7cc0a9d02584 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:15:29.850629 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-7084d06c-88b3-4302-9c58-675dadaeb170 tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] Calling method '.version_select at 0x7f1e0be5e040>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:29.900245 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-7084d06c-88b3-4302-9c58-675dadaeb170 tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/81f99811-98c3-4039-8efb-7cc0a9d02584" status: 200 len: 353 microversion: 2.1 time: 0.053832 May 16 19:15:29.900823 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 524/1090] 10.222.0.24 () {58 vars in 1244 bytes} [Mon May 16 19:15:29 2022] GET /compute/v2.1/os-volumes/81f99811-98c3-4039-8efb-7cc0a9d02584 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:15:29.912406 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9eefe922-c473-4273-9a8b-5357c8521faf tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] Calling method '.version_select at 0x7f1e1906aaf0>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:29.961060 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9eefe922-c473-4273-9a8b-5357c8521faf tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/81f99811-98c3-4039-8efb-7cc0a9d02584" status: 200 len: 353 microversion: 2.1 time: 0.052957 May 16 19:15:29.961660 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 567/1091] 10.222.0.24 () {58 vars in 1244 bytes} [Mon May 16 19:15:29 2022] GET /compute/v2.1/os-volumes/81f99811-98c3-4039-8efb-7cc0a9d02584 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:15:29.978019 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d8bbbf77-b96d-4ef6-9a13-3ee61a6044b3 tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] Calling method '.version_select at 0x7f1e0be1d160>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:30.039936 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d8bbbf77-b96d-4ef6-9a13-3ee61a6044b3 tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/81f99811-98c3-4039-8efb-7cc0a9d02584" status: 202 len: 0 microversion: 2.1 time: 0.066015 May 16 19:15:30.040583 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 525/1092] 10.222.0.24 () {58 vars in 1247 bytes} [Mon May 16 19:15:29 2022] DELETE /compute/v2.1/os-volumes/81f99811-98c3-4039-8efb-7cc0a9d02584 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:15:30.048892 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d92c7bc3-b2c0-4958-a152-4aa7a9340dcd tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] Calling method '.version_select at 0x7f1e1d866310>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:30.096138 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d92c7bc3-b2c0-4958-a152-4aa7a9340dcd tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/81f99811-98c3-4039-8efb-7cc0a9d02584" status: 200 len: 352 microversion: 2.1 time: 0.051153 May 16 19:15:30.096715 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 568/1093] 10.222.0.24 () {58 vars in 1244 bytes} [Mon May 16 19:15:30 2022] GET /compute/v2.1/os-volumes/81f99811-98c3-4039-8efb-7cc0a9d02584 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:15:31.108612 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-cd343653-4aa3-4c2f-99f3-fafc5a82d1db tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] Calling method '.version_select at 0x7f1e0be129d0>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:15:31.136155 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-cd343653-4aa3-4c2f-99f3-fafc5a82d1db tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] HTTP exception thrown: Volume 81f99811-98c3-4039-8efb-7cc0a9d02584 could not be found. May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-cd343653-4aa3-4c2f-99f3-fafc5a82d1db tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] Request method failure captured: May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/os-volumes/81f99811-98c3-4039-8efb-7cc0a9d02584 HTTP/1.1 May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqLQXPtgBfeVzSjzDqgXR3vvSZrpuHSc6_HGFvGiHHvfgkUmm1qeTjpgqF9Wsn6EJ7YzWEfF1WMNc7saDI5uJtgxo8Kf5VgxR3J8fSXlEpmVDiVO_r4DFRgeibAFPJg2aZWSkafq2_ZQ-vRPCpp4oDWpW_F4cAZkxEPdmrIt5jhRiIE May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: fdfde41b98ec442882196ab8ee751428 May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-VolumesGetTestJSON-1640651519 May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:15:31.145833 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:15:31.147295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/fdfde41b98ec442882196ab8ee751428"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/fdfde41b98ec442882196ab8ee751428"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/fdfde41b98ec442882196ab8ee751428"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_fdfde41b98ec442882196ab8ee751428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:15:31.147295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-VolumesGetTestJSON-1640651519 May 16 19:15:31.147295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: fdfde41b98ec442882196ab8ee751428 May 16 19:15:31.147295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-VolumesGetTestJSON-1640651519 May 16 19:15:31.147295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-VolumesGetTestJSON-1640651519-project May 16 19:15:31.147295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:15:31.147295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:15:31.147295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 3692612adb214ab496caa11ce55b57b1 May 16 19:15:31.147295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-VolumesGetTestJSON-1640651519-project May 16 19:15:31.147295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: May 16 19:15:31.147295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Volume 81f99811-98c3-4039-8efb-7cc0a9d02584 could not be found. May 16 19:15:31.147295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': '81f99811-98c3-4039-8efb-7cc0a9d02584'} May 16 19:15:31.147295 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81f99811-98c3-4039-8efb-7cc0a9d02584 could not be found. (HTTP 404) (Request-ID: req-f668b401-2096-4773-a65e-cec694a55bd7) May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:31.148186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 19:15:31.149465 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81f99811-98c3-4039-8efb-7cc0a9d02584 could not be found. May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 19:15:31.150664 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:15:31.151880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81f99811-98c3-4039-8efb-7cc0a9d02584 could not be found. May 16 19:15:31.151880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:31.151880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:15:31.151880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:31.151880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:15:31.151880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:15:31.151880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:15:31.151880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:15:31.151880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:15:31.151880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81f99811-98c3-4039-8efb-7cc0a9d02584 could not be found. May 16 19:15:31.151880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:15:31.151880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-cd343653-4aa3-4c2f-99f3-fafc5a82d1db tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] Returning 404 to user: Volume 81f99811-98c3-4039-8efb-7cc0a9d02584 could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:15:31.151880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-cd343653-4aa3-4c2f-99f3-fafc5a82d1db tempest-VolumesGetTestJSON-1640651519 tempest-VolumesGetTestJSON-1640651519-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/81f99811-98c3-4039-8efb-7cc0a9d02584" status: 404 len: 109 microversion: 2.1 time: 0.043168 May 16 19:15:31.151880 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 526/1094] 10.222.0.24 () {58 vars in 1244 bytes} [Mon May 16 19:15:31 2022] GET /compute/v2.1/os-volumes/81f99811-98c3-4039-8efb-7cc0a9d02584 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:16:02.218302 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0ee58600-5407-455d-8127-67c140a09bc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:02.219228 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0ee58600-5407-455d-8127-67c140a09bc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:02.225650 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0ee58600-5407-455d-8127-67c140a09bc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:02.226096 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0ee58600-5407-455d-8127-67c140a09bc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:02.226881 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0ee58600-5407-455d-8127-67c140a09bc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:02.227312 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0ee58600-5407-455d-8127-67c140a09bc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:02.255063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0ee58600-5407-455d-8127-67c140a09bc5 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041744 May 16 19:16:02.255610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 569/1095] 10.222.0.24 () {60 vars in 1342 bytes} [Mon May 16 19:16:02 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:02.316316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5853f237-4ae2-4b2f-bc63-d1335e66f104 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:02.316861 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5853f237-4ae2-4b2f-bc63-d1335e66f104 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:02.322895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5853f237-4ae2-4b2f-bc63-d1335e66f104 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:02.323338 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5853f237-4ae2-4b2f-bc63-d1335e66f104 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:02.324141 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5853f237-4ae2-4b2f-bc63-d1335e66f104 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:02.324564 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-5853f237-4ae2-4b2f-bc63-d1335e66f104 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:02.354476 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-5853f237-4ae2-4b2f-bc63-d1335e66f104 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Going to try to terminate instance {{(pid=117275) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:16:02.437139 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5853f237-4ae2-4b2f-bc63-d1335e66f104 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 204 len: 0 microversion: 2.20 time: 0.125581 May 16 19:16:02.437952 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 527/1096] 10.222.0.24 () {60 vars in 1279 bytes} [Mon May 16 19:16:02 2022] DELETE /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 19:16:02.446248 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ec0590ca-95e7-4446-88ec-bb5c09cbfd29 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:02.446863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ec0590ca-95e7-4446-88ec-bb5c09cbfd29 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:02.453085 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec0590ca-95e7-4446-88ec-bb5c09cbfd29 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:02.453581 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec0590ca-95e7-4446-88ec-bb5c09cbfd29 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:02.454361 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec0590ca-95e7-4446-88ec-bb5c09cbfd29 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:02.454800 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec0590ca-95e7-4446-88ec-bb5c09cbfd29 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:02.588043 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ec0590ca-95e7-4446-88ec-bb5c09cbfd29 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:02.596215 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ec0590ca-95e7-4446-88ec-bb5c09cbfd29 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:02.597742 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ec0590ca-95e7-4446-88ec-bb5c09cbfd29 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:02.598958 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ec0590ca-95e7-4446-88ec-bb5c09cbfd29 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1724 microversion: 2.20 time: 0.156677 May 16 19:16:02.599599 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 570/1097] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:16:02 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:16:03.621680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-6935a958-2ad9-42a1-9cb7-8df80b5f461a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:03.622333 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-6935a958-2ad9-42a1-9cb7-8df80b5f461a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:03.629182 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6935a958-2ad9-42a1-9cb7-8df80b5f461a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:03.630160 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6935a958-2ad9-42a1-9cb7-8df80b5f461a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:03.630395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6935a958-2ad9-42a1-9cb7-8df80b5f461a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:03.630826 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-6935a958-2ad9-42a1-9cb7-8df80b5f461a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:03.760416 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6935a958-2ad9-42a1-9cb7-8df80b5f461a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:03.770352 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6935a958-2ad9-42a1-9cb7-8df80b5f461a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:03.772051 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-6935a958-2ad9-42a1-9cb7-8df80b5f461a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:03.773326 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-6935a958-2ad9-42a1-9cb7-8df80b5f461a tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1724 microversion: 2.20 time: 0.157914 May 16 19:16:03.773927 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 528/1098] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:16:03 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:16:04.792735 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-688f24d5-31c1-4013-b82f-75f2b965483c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:04.793603 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-688f24d5-31c1-4013-b82f-75f2b965483c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:04.801716 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-688f24d5-31c1-4013-b82f-75f2b965483c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:04.802171 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-688f24d5-31c1-4013-b82f-75f2b965483c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:04.802940 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-688f24d5-31c1-4013-b82f-75f2b965483c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:04.803542 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-688f24d5-31c1-4013-b82f-75f2b965483c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:04.876310 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-688f24d5-31c1-4013-b82f-75f2b965483c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:04.885481 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-688f24d5-31c1-4013-b82f-75f2b965483c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:04.887197 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-688f24d5-31c1-4013-b82f-75f2b965483c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661228875e4d4c60a558656b46ea650b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70432660a05b4b169939f7048c545bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:04.888382 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-688f24d5-31c1-4013-b82f-75f2b965483c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 200 len: 1656 microversion: 2.20 time: 0.100228 May 16 19:16:04.889275 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 571/1099] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:16:04 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 1656 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 19:16:04.989052 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-777d7a32-59a0-4e6f-a979-52954d8781ae req-077c7283-a8a1-46fa-a4cc-d443023d850e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b664a08c-f97e-4c52-b849-9eddb2e65be5", "name": "network-vif-deleted", "tag": "34940ecb-c2a4-45ca-ad50-7ea9f112b22a"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:16:05.000498 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-777d7a32-59a0-4e6f-a979-52954d8781ae req-077c7283-a8a1-46fa-a4cc-d443023d850e service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:05.001163 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-777d7a32-59a0-4e6f-a979-52954d8781ae req-077c7283-a8a1-46fa-a4cc-d443023d850e service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:05.014787 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-777d7a32-59a0-4e6f-a979-52954d8781ae req-077c7283-a8a1-46fa-a4cc-d443023d850e service nova] Creating event network-vif-deleted:34940ecb-c2a4-45ca-ad50-7ea9f112b22a for instance b664a08c-f97e-4c52-b849-9eddb2e65be5 on hv-cinder-76606 May 16 19:16:05.027762 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-777d7a32-59a0-4e6f-a979-52954d8781ae req-077c7283-a8a1-46fa-a4cc-d443023d850e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046642 May 16 19:16:05.029564 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 529/1100] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:16:05.908676 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7155ea59-55c8-4d73-9627-de663de2694e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:05.909645 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7155ea59-55c8-4d73-9627-de663de2694e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:05.918608 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7155ea59-55c8-4d73-9627-de663de2694e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:05.919232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7155ea59-55c8-4d73-9627-de663de2694e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:05.920230 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7155ea59-55c8-4d73-9627-de663de2694e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:05.920751 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7155ea59-55c8-4d73-9627-de663de2694e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:05.936857 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-7155ea59-55c8-4d73-9627-de663de2694e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] HTTP exception thrown: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7155ea59-55c8-4d73-9627-de663de2694e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Request method failure captured: May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 HTTP/1.1 May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqEf8G2zG4vGLa6fRQSxVwXOFVu4jsLZ-B29p_0lSs6jcAWOYCZkY1DornZdhZVXCJqS0zwV5auuRvXLpuRGlzre_qEDa7s0YeoNCV-K5cylz8uVnntU7yWfEsEGHGxlrx6W7bVdUfRTVT8W0BjJSqyY4x_YtcipuicFgB8svbPs79I May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Openstack-Nova-Api-Version: 2.20 May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: 70432660a05b4b169939f7048c545bfc May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:16:05.938519 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:16:05.940293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/70432660a05b4b169939f7048c545bfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/70432660a05b4b169939f7048c545bfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/70432660a05b4b169939f7048c545bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_70432660a05b4b169939f7048c545bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:16:05.940293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:16:05.940293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: 70432660a05b4b169939f7048c545bfc May 16 19:16:05.940293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:16:05.940293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-AttachVolumeShelveTestJSON-1982681477-project May 16 19:16:05.940293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:16:05.940293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:16:05.940293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 661228875e4d4c60a558656b46ea650b May 16 19:16:05.940293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1982681477-project May 16 19:16:05.940293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:16:05.940293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. May 16 19:16:05.940293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': 'b664a08c-f97e-4c52-b849-9eddb2e65be5'} May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:16:05.941700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. May 16 19:16:05.943591 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:05.949104 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7155ea59-55c8-4d73-9627-de663de2694e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Returning 404 to user: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:16:05.949104 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7155ea59-55c8-4d73-9627-de663de2694e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 404 len: 111 microversion: 2.20 time: 0.038474 May 16 19:16:05.949104 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 572/1101] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:16:05 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 19:16:05.959574 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-5b69ab67-6452-49a5-b80f-b32b22bd83a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '.version_select at 0x7f1e0be47310>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:05.994769 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-5b69ab67-6452-49a5-b80f-b32b22bd83a1 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-403318568" status: 204 len: 0 microversion: 2.20 time: 0.045036 May 16 19:16:05.996281 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 530/1102] 10.222.0.24 () {60 vars in 1258 bytes} [Mon May 16 19:16:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-403318568 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 19:16:08.116290 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8631ef92-0075-426c-801b-0e3a0063f677 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:08.116791 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8631ef92-0075-426c-801b-0e3a0063f677 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:08.123873 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8631ef92-0075-426c-801b-0e3a0063f677 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:08.124320 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8631ef92-0075-426c-801b-0e3a0063f677 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:08.125103 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8631ef92-0075-426c-801b-0e3a0063f677 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:08.125570 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8631ef92-0075-426c-801b-0e3a0063f677 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:08.139501 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-8631ef92-0075-426c-801b-0e3a0063f677 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] HTTP exception thrown: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8631ef92-0075-426c-801b-0e3a0063f677 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Request method failure captured: May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: DELETE /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 HTTP/1.1 May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqEf8G2zG4vGLa6fRQSxVwXOFVu4jsLZ-B29p_0lSs6jcAWOYCZkY1DornZdhZVXCJqS0zwV5auuRvXLpuRGlzre_qEDa7s0YeoNCV-K5cylz8uVnntU7yWfEsEGHGxlrx6W7bVdUfRTVT8W0BjJSqyY4x_YtcipuicFgB8svbPs79I May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Openstack-Nova-Api-Version: 2.20 May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: 70432660a05b4b169939f7048c545bfc May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:16:08.141411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:16:08.143140 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/70432660a05b4b169939f7048c545bfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/70432660a05b4b169939f7048c545bfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/70432660a05b4b169939f7048c545bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_70432660a05b4b169939f7048c545bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:16:08.143140 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:16:08.143140 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: 70432660a05b4b169939f7048c545bfc May 16 19:16:08.143140 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:16:08.143140 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-AttachVolumeShelveTestJSON-1982681477-project May 16 19:16:08.143140 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:16:08.143140 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:16:08.143140 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 661228875e4d4c60a558656b46ea650b May 16 19:16:08.143140 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1982681477-project May 16 19:16:08.143140 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:16:08.143140 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. May 16 19:16:08.143140 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': 'b664a08c-f97e-4c52-b849-9eddb2e65be5'} May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:16:08.143984 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. May 16 19:16:08.145226 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:08.146514 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8631ef92-0075-426c-801b-0e3a0063f677 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Returning 404 to user: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:16:08.146514 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8631ef92-0075-426c-801b-0e3a0063f677 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 404 len: 111 microversion: 2.20 time: 0.031331 May 16 19:16:08.146514 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 573/1103] 10.222.0.24 () {60 vars in 1279 bytes} [Mon May 16 19:16:08 2022] DELETE /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 19:16:08.152387 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-7802e6b8-b2b6-4aa1-9836-b8d3b238622e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:08.153149 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-7802e6b8-b2b6-4aa1-9836-b8d3b238622e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: b664a08c-f97e-4c52-b849-9eddb2e65be5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:08.159926 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7802e6b8-b2b6-4aa1-9836-b8d3b238622e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:08.160368 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7802e6b8-b2b6-4aa1-9836-b8d3b238622e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:08.161131 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7802e6b8-b2b6-4aa1-9836-b8d3b238622e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:08.161676 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-7802e6b8-b2b6-4aa1-9836-b8d3b238622e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:08.175541 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-7802e6b8-b2b6-4aa1-9836-b8d3b238622e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] HTTP exception thrown: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-7802e6b8-b2b6-4aa1-9836-b8d3b238622e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Request method failure captured: May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 HTTP/1.1 May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqEf8G2zG4vGLa6fRQSxVwXOFVu4jsLZ-B29p_0lSs6jcAWOYCZkY1DornZdhZVXCJqS0zwV5auuRvXLpuRGlzre_qEDa7s0YeoNCV-K5cylz8uVnntU7yWfEsEGHGxlrx6W7bVdUfRTVT8W0BjJSqyY4x_YtcipuicFgB8svbPs79I May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Openstack-Nova-Api-Version: 2.20 May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: 70432660a05b4b169939f7048c545bfc May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:16:08.177188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:16:08.178891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/70432660a05b4b169939f7048c545bfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/70432660a05b4b169939f7048c545bfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/70432660a05b4b169939f7048c545bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_70432660a05b4b169939f7048c545bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:16:08.178891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:16:08.178891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: 70432660a05b4b169939f7048c545bfc May 16 19:16:08.178891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:16:08.178891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-AttachVolumeShelveTestJSON-1982681477-project May 16 19:16:08.178891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:16:08.178891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:16:08.178891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 661228875e4d4c60a558656b46ea650b May 16 19:16:08.178891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1982681477-project May 16 19:16:08.178891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:16:08.178891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. May 16 19:16:08.178891 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': 'b664a08c-f97e-4c52-b849-9eddb2e65be5'} May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:16:08.179817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. May 16 19:16:08.181312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:08.182796 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-7802e6b8-b2b6-4aa1-9836-b8d3b238622e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Returning 404 to user: Instance b664a08c-f97e-4c52-b849-9eddb2e65be5 could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:16:08.182796 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-7802e6b8-b2b6-4aa1-9836-b8d3b238622e tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5" status: 404 len: 111 microversion: 2.20 time: 0.030874 May 16 19:16:08.182796 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 531/1104] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:16:08 2022] GET /compute/v2.1/servers/b664a08c-f97e-4c52-b849-9eddb2e65be5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 19:16:09.316817 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-161feb84-4a4b-48a0-bc62-0b16dfb41d11 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:09.317328 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-161feb84-4a4b-48a0-bc62-0b16dfb41d11 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:09.323810 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-161feb84-4a4b-48a0-bc62-0b16dfb41d11 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:09.324251 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-161feb84-4a4b-48a0-bc62-0b16dfb41d11 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:09.325006 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-161feb84-4a4b-48a0-bc62-0b16dfb41d11 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:09.325431 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-161feb84-4a4b-48a0-bc62-0b16dfb41d11 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:09.340187 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-161feb84-4a4b-48a0-bc62-0b16dfb41d11 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] HTTP exception thrown: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-161feb84-4a4b-48a0-bc62-0b16dfb41d11 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Request method failure captured: May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: DELETE /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 HTTP/1.1 May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqEf8G2zG4vGLa6fRQSxVwXOFVu4jsLZ-B29p_0lSs6jcAWOYCZkY1DornZdhZVXCJqS0zwV5auuRvXLpuRGlzre_qEDa7s0YeoNCV-K5cylz8uVnntU7yWfEsEGHGxlrx6W7bVdUfRTVT8W0BjJSqyY4x_YtcipuicFgB8svbPs79I May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Openstack-Nova-Api-Version: 2.20 May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: 70432660a05b4b169939f7048c545bfc May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:16:09.341954 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:16:09.343631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/70432660a05b4b169939f7048c545bfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/70432660a05b4b169939f7048c545bfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/70432660a05b4b169939f7048c545bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_70432660a05b4b169939f7048c545bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:16:09.343631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:16:09.343631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: 70432660a05b4b169939f7048c545bfc May 16 19:16:09.343631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:16:09.343631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-AttachVolumeShelveTestJSON-1982681477-project May 16 19:16:09.343631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:16:09.343631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:16:09.343631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 661228875e4d4c60a558656b46ea650b May 16 19:16:09.343631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1982681477-project May 16 19:16:09.343631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:16:09.343631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. May 16 19:16:09.343631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': 'd5b53695-b6e7-4e7b-b6d5-539770d20f41'} May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:16:09.344691 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. May 16 19:16:09.346232 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:09.348158 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-161feb84-4a4b-48a0-bc62-0b16dfb41d11 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Returning 404 to user: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:16:09.348158 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-161feb84-4a4b-48a0-bc62-0b16dfb41d11 tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 404 len: 111 microversion: 2.20 time: 0.030575 May 16 19:16:09.348158 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 574/1105] 10.222.0.24 () {60 vars in 1279 bytes} [Mon May 16 19:16:09 2022] DELETE /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 19:16:09.351981 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-53c432aa-2821-48bb-8657-120b8190d28c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:09.352558 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-53c432aa-2821-48bb-8657-120b8190d28c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] [instance: d5b53695-b6e7-4e7b-b6d5-539770d20f41] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:09.359406 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-53c432aa-2821-48bb-8657-120b8190d28c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:09.359930 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-53c432aa-2821-48bb-8657-120b8190d28c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:09.360810 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-53c432aa-2821-48bb-8657-120b8190d28c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:09.361316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-53c432aa-2821-48bb-8657-120b8190d28c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:09.377379 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-53c432aa-2821-48bb-8657-120b8190d28c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] HTTP exception thrown: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-53c432aa-2821-48bb-8657-120b8190d28c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Request method failure captured: May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 HTTP/1.1 May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqEf8G2zG4vGLa6fRQSxVwXOFVu4jsLZ-B29p_0lSs6jcAWOYCZkY1DornZdhZVXCJqS0zwV5auuRvXLpuRGlzre_qEDa7s0YeoNCV-K5cylz8uVnntU7yWfEsEGHGxlrx6W7bVdUfRTVT8W0BjJSqyY4x_YtcipuicFgB8svbPs79I May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Openstack-Nova-Api-Version: 2.20 May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: 70432660a05b4b169939f7048c545bfc May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:16:09.378922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:16:09.380680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/70432660a05b4b169939f7048c545bfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/70432660a05b4b169939f7048c545bfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/70432660a05b4b169939f7048c545bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_70432660a05b4b169939f7048c545bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:16:09.380680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:16:09.380680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: 70432660a05b4b169939f7048c545bfc May 16 19:16:09.380680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1982681477 May 16 19:16:09.380680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-AttachVolumeShelveTestJSON-1982681477-project May 16 19:16:09.380680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:16:09.380680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:16:09.380680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 661228875e4d4c60a558656b46ea650b May 16 19:16:09.380680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1982681477-project May 16 19:16:09.380680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:16:09.380680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. May 16 19:16:09.380680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': 'd5b53695-b6e7-4e7b-b6d5-539770d20f41'} May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:16:09.381915 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. May 16 19:16:09.383651 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:09.385632 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-53c432aa-2821-48bb-8657-120b8190d28c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] Returning 404 to user: Instance d5b53695-b6e7-4e7b-b6d5-539770d20f41 could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:16:09.385632 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-53c432aa-2821-48bb-8657-120b8190d28c tempest-AttachVolumeShelveTestJSON-1982681477 tempest-AttachVolumeShelveTestJSON-1982681477-project] 10.222.0.24 "GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41" status: 404 len: 111 microversion: 2.20 time: 0.032285 May 16 19:16:09.385632 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 532/1106] 10.222.0.24 () {60 vars in 1276 bytes} [Mon May 16 19:16:09 2022] GET /compute/v2.1/servers/d5b53695-b6e7-4e7b-b6d5-539770d20f41 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 19:16:14.252354 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8607de94-2ca3-4459-9685-f901b3176fd8 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Action: 'create', calling method: .version_select at 0x7f1e19014790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1279836534"}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:16:14.541125 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8607de94-2ca3-4459-9685-f901b3176fd8 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.408634 May 16 19:16:14.541793 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 575/1107] 10.222.0.24 () {60 vars in 1154 bytes} [Mon May 16 19:16:14 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 410 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 16 19:16:14.553100 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e2904aac-b289-4905-b2b1-da9a80df4f66 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Calling method '.version_select at 0x7f1e0be87310>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:14.607333 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e2904aac-b289-4905-b2b1-da9a80df4f66 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43" status: 200 len: 345 microversion: 2.1 time: 0.058360 May 16 19:16:14.607899 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 533/1108] 10.222.0.24 () {58 vars in 1244 bytes} [Mon May 16 19:16:14 2022] GET /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:16:15.620441 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e3c0a248-3eae-4249-b2cf-a6ed264dd3ed tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Calling method '.version_select at 0x7f1e191128b0>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:15.668401 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e3c0a248-3eae-4249-b2cf-a6ed264dd3ed tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43" status: 200 len: 346 microversion: 2.1 time: 0.052546 May 16 19:16:15.668979 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 576/1109] 10.222.0.24 () {58 vars in 1244 bytes} [Mon May 16 19:16:15 2022] GET /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:16:15.680680 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-bf162a02-618f-405c-852f-517317835172 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Action: 'create', calling method: .version_select at 0x7f1e0be1df70>, body: {"snapshot": {"volume_id": "b3ec5042-1cc1-4017-9821-53dc89101e43", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-805630845"}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:16:15.836599 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-bf162a02-618f-405c-852f-517317835172 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.160253 May 16 19:16:15.837291 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 534/1110] 10.222.0.24 () {60 vars in 1161 bytes} [Mon May 16 19:16:15 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:16:15.847239 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d9d1af7a-bf58-46be-9683-f37e47213d3c tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Calling method '.version_select at 0x7f1e1906e280>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:15.878809 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d9d1af7a-bf58-46be-9683-f37e47213d3c tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297" status: 200 len: 286 microversion: 2.1 time: 0.035522 May 16 19:16:15.879450 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 577/1111] 10.222.0.24 () {58 vars in 1250 bytes} [Mon May 16 19:16:15 2022] GET /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:16:15.890413 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-3c622f94-465c-4af0-a547-6838acc8808b tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Calling method '.version_select at 0x7f1e0be32280>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:15.919097 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-3c622f94-465c-4af0-a547-6838acc8808b tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033631 May 16 19:16:15.919730 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 535/1112] 10.222.0.24 () {58 vars in 1139 bytes} [Mon May 16 19:16:15 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:16:15.929704 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-b3095abd-a040-40c1-b3ba-4ae7525880a6 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Calling method '.version_select at 0x7f1e192ed280>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:15.958608 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-b3095abd-a040-40c1-b3ba-4ae7525880a6 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297" status: 200 len: 286 microversion: 2.1 time: 0.032601 May 16 19:16:15.959228 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 578/1113] 10.222.0.24 () {58 vars in 1250 bytes} [Mon May 16 19:16:15 2022] GET /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:16:16.971353 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-23a162de-a754-40d6-bc5b-861c03f0e882 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Calling method '.version_select at 0x7f1e0be87430>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:17.000450 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-23a162de-a754-40d6-bc5b-861c03f0e882 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297" status: 200 len: 286 microversion: 2.1 time: 0.032780 May 16 19:16:17.001178 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 536/1114] 10.222.0.24 () {58 vars in 1250 bytes} [Mon May 16 19:16:16 2022] GET /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:16:18.018022 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ebb1d12f-b669-45ed-8be5-7b318567ef4e tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Calling method '.version_select at 0x7f1e19014670>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:18.057379 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ebb1d12f-b669-45ed-8be5-7b318567ef4e tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297" status: 200 len: 286 microversion: 2.1 time: 0.047347 May 16 19:16:18.057973 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 579/1115] 10.222.0.24 () {58 vars in 1250 bytes} [Mon May 16 19:16:18 2022] GET /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:16:19.074514 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b623ecb1-f209-4a4e-a1cb-e229ec1e5d14 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Calling method '.version_select at 0x7f1e0be29430>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:19.110840 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b623ecb1-f209-4a4e-a1cb-e229ec1e5d14 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297" status: 200 len: 287 microversion: 2.1 time: 0.043701 May 16 19:16:19.111422 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 537/1116] 10.222.0.24 () {58 vars in 1250 bytes} [Mon May 16 19:16:19 2022] GET /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:16:19.122723 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ed9d5b5d-de8c-456c-888c-709027604533 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Calling method '.version_select at 0x7f1e19013670>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:19.181404 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ed9d5b5d-de8c-456c-888c-709027604533 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "DELETE /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297" status: 202 len: 0 microversion: 2.1 time: 0.063143 May 16 19:16:19.182007 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 580/1117] 10.222.0.24 () {58 vars in 1253 bytes} [Mon May 16 19:16:19 2022] DELETE /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:16:19.190757 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-981f6e19-253f-4416-891b-8c9284222d0a tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Calling method '.version_select at 0x7f1e0be1d9d0>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:19.221456 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-981f6e19-253f-4416-891b-8c9284222d0a tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297" status: 200 len: 286 microversion: 2.1 time: 0.034890 May 16 19:16:19.222128 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 538/1118] 10.222.0.24 () {58 vars in 1250 bytes} [Mon May 16 19:16:19 2022] GET /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:16:20.237700 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a5b2ffda-2930-4b4a-a62d-6a75789bf09f tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Calling method '.version_select at 0x7f1e191ea790>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:20.269050 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-a5b2ffda-2930-4b4a-a62d-6a75789bf09f tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] HTTP exception thrown: Snapshot 3909477a-0e38-47ac-bda1-d7adcd215297 could not be found. May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a5b2ffda-2930-4b4a-a62d-6a75789bf09f tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Request method failure captured: May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: GET /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297 HTTP/1.1 May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqL-wppcCv1QpOv44WIniqzlc1zLYOjYkykJA-aF6b317qXBpax8tYFoG0Nx7xAHkYz4s9ZfqWPtiySgCdUhNjBn7R_WP4VWtvQ5HBh2RyA7mUHPwo6XMfocQtomKqKEktFmYEqrojWhpRaTXSMslTuKyXiMIWcgTDr0nRvYuUsuGR0 May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: 3e697bfab5ea482583276af140f451c2 May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2069154498 May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:16:20.272126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:16:20.273782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3e697bfab5ea482583276af140f451c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3e697bfab5ea482583276af140f451c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3e697bfab5ea482583276af140f451c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3e697bfab5ea482583276af140f451c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:16:20.273782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2069154498 May 16 19:16:20.273782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: 3e697bfab5ea482583276af140f451c2 May 16 19:16:20.273782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2069154498 May 16 19:16:20.273782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-VolumesSnapshotsTestJSON-2069154498-project May 16 19:16:20.273782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:16:20.273782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:16:20.273782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 5e317eec8c124eeaa373cdc1c4da1718 May 16 19:16:20.273782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2069154498-project May 16 19:16:20.273782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: May 16 19:16:20.273782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Snapshot 3909477a-0e38-47ac-bda1-d7adcd215297 could not be found. May 16 19:16:20.273782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': '3909477a-0e38-47ac-bda1-d7adcd215297'} May 16 19:16:20.273782 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3909477a-0e38-47ac-bda1-d7adcd215297 could not be found. (HTTP 404) (Request-ID: req-f80e239c-316c-44e5-8b7b-672b1e901b4b) May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:20.274771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 19:16:20.276053 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3909477a-0e38-47ac-bda1-d7adcd215297 could not be found. May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 16 19:16:20.277668 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:16:20.279235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3909477a-0e38-47ac-bda1-d7adcd215297 could not be found. May 16 19:16:20.279235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:20.279235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:20.279235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:20.279235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:20.279235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:20.279235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:20.279235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:16:20.279235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:16:20.279235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3909477a-0e38-47ac-bda1-d7adcd215297 could not be found. May 16 19:16:20.279235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:20.279235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a5b2ffda-2930-4b4a-a62d-6a75789bf09f tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Returning 404 to user: Snapshot 3909477a-0e38-47ac-bda1-d7adcd215297 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:16:20.279235 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a5b2ffda-2930-4b4a-a62d-6a75789bf09f tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297" status: 404 len: 111 microversion: 2.1 time: 0.042418 May 16 19:16:20.280263 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 581/1119] 10.222.0.24 () {58 vars in 1250 bytes} [Mon May 16 19:16:20 2022] GET /compute/v2.1/os-snapshots/3909477a-0e38-47ac-bda1-d7adcd215297 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:16:20.282764 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0fc60bc5-4a29-4744-b97c-13298847cb0f tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Calling method '.version_select at 0x7f1e0be87af0>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:20.345314 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0fc60bc5-4a29-4744-b97c-13298847cb0f tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43" status: 202 len: 0 microversion: 2.1 time: 0.066806 May 16 19:16:20.346032 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 539/1120] 10.222.0.24 () {58 vars in 1247 bytes} [Mon May 16 19:16:20 2022] DELETE /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:16:20.355296 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8d54ea9a-5148-4063-affe-ad4327f5cbae tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Calling method '.version_select at 0x7f1e191ea5e0>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:20.401922 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8d54ea9a-5148-4063-affe-ad4327f5cbae tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43" status: 200 len: 345 microversion: 2.1 time: 0.050395 May 16 19:16:20.402511 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 582/1121] 10.222.0.24 () {58 vars in 1244 bytes} [Mon May 16 19:16:20 2022] GET /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:16:21.419655 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c1a236a8-7324-4072-b71c-f4ae0a637f38 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Calling method '.version_select at 0x7f1e0be295e0>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:21.453323 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-c1a236a8-7324-4072-b71c-f4ae0a637f38 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] HTTP exception thrown: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c1a236a8-7324-4072-b71c-f4ae0a637f38 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Request method failure captured: May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43 HTTP/1.1 May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqL-wppcCv1QpOv44WIniqzlc1zLYOjYkykJA-aF6b317qXBpax8tYFoG0Nx7xAHkYz4s9ZfqWPtiySgCdUhNjBn7R_WP4VWtvQ5HBh2RyA7mUHPwo6XMfocQtomKqKEktFmYEqrojWhpRaTXSMslTuKyXiMIWcgTDr0nRvYuUsuGR0 May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: 3e697bfab5ea482583276af140f451c2 May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2069154498 May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:16:21.455395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:16:21.457047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3e697bfab5ea482583276af140f451c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3e697bfab5ea482583276af140f451c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3e697bfab5ea482583276af140f451c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3e697bfab5ea482583276af140f451c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:16:21.457047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2069154498 May 16 19:16:21.457047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: 3e697bfab5ea482583276af140f451c2 May 16 19:16:21.457047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2069154498 May 16 19:16:21.457047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-VolumesSnapshotsTestJSON-2069154498-project May 16 19:16:21.457047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:16:21.457047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:16:21.457047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 5e317eec8c124eeaa373cdc1c4da1718 May 16 19:16:21.457047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2069154498-project May 16 19:16:21.457047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: May 16 19:16:21.457047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. May 16 19:16:21.457047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': 'b3ec5042-1cc1-4017-9821-53dc89101e43'} May 16 19:16:21.457047 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. (HTTP 404) (Request-ID: req-ab6993d3-fafc-4ec0-b5a2-84911518cae0) May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:21.457922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 19:16:21.459277 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 19:16:21.460974 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:16:21.463002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. May 16 19:16:21.463002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:21.463002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:21.463002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:21.463002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:21.463002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:21.463002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:21.463002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:16:21.463002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:16:21.463002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. May 16 19:16:21.463002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:21.463002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c1a236a8-7324-4072-b71c-f4ae0a637f38 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Returning 404 to user: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:16:21.463002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c1a236a8-7324-4072-b71c-f4ae0a637f38 tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43" status: 404 len: 109 microversion: 2.1 time: 0.044570 May 16 19:16:21.463002 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 540/1122] 10.222.0.24 () {58 vars in 1244 bytes} [Mon May 16 19:16:21 2022] GET /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:16:21.470346 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a9f659ea-b72a-48e4-8510-213d6ec9ce3b tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Calling method '.version_select at 0x7f1e18f5df70>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:21.504739 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-a9f659ea-b72a-48e4-8510-213d6ec9ce3b tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] HTTP exception thrown: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a9f659ea-b72a-48e4-8510-213d6ec9ce3b tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Request method failure captured: May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: DELETE /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43 HTTP/1.1 May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqL-wppcCv1QpOv44WIniqzlc1zLYOjYkykJA-aF6b317qXBpax8tYFoG0Nx7xAHkYz4s9ZfqWPtiySgCdUhNjBn7R_WP4VWtvQ5HBh2RyA7mUHPwo6XMfocQtomKqKEktFmYEqrojWhpRaTXSMslTuKyXiMIWcgTDr0nRvYuUsuGR0 May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: 3e697bfab5ea482583276af140f451c2 May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2069154498 May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:16:21.507021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:16:21.508565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3e697bfab5ea482583276af140f451c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3e697bfab5ea482583276af140f451c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3e697bfab5ea482583276af140f451c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3e697bfab5ea482583276af140f451c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:16:21.508565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2069154498 May 16 19:16:21.508565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: 3e697bfab5ea482583276af140f451c2 May 16 19:16:21.508565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2069154498 May 16 19:16:21.508565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-VolumesSnapshotsTestJSON-2069154498-project May 16 19:16:21.508565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:16:21.508565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:16:21.508565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 5e317eec8c124eeaa373cdc1c4da1718 May 16 19:16:21.508565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2069154498-project May 16 19:16:21.508565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: May 16 19:16:21.508565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. May 16 19:16:21.508565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': 'b3ec5042-1cc1-4017-9821-53dc89101e43'} May 16 19:16:21.508565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. (HTTP 404) (Request-ID: req-a892207b-ab8c-4397-9077-a22bb6ca9b04) May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:21.509418 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 19:16:21.510756 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 19:16:21.512362 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:16:21.513903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. May 16 19:16:21.513903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:21.513903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:21.513903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:21.513903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:21.513903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:21.513903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:21.513903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:16:21.513903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:16:21.513903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. May 16 19:16:21.513903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:21.513903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a9f659ea-b72a-48e4-8510-213d6ec9ce3b tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Returning 404 to user: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:16:21.513903 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a9f659ea-b72a-48e4-8510-213d6ec9ce3b tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43" status: 404 len: 109 microversion: 2.1 time: 0.042683 May 16 19:16:21.515351 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 583/1123] 10.222.0.24 () {58 vars in 1247 bytes} [Mon May 16 19:16:21 2022] DELETE /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:16:21.517627 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ffd534a4-8ada-42e1-a4fb-e50a251e910e tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Calling method '.version_select at 0x7f1e0be870d0>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:21.545186 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-ffd534a4-8ada-42e1-a4fb-e50a251e910e tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] HTTP exception thrown: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ffd534a4-8ada-42e1-a4fb-e50a251e910e tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Request method failure captured: May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43 HTTP/1.1 May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqL-wppcCv1QpOv44WIniqzlc1zLYOjYkykJA-aF6b317qXBpax8tYFoG0Nx7xAHkYz4s9ZfqWPtiySgCdUhNjBn7R_WP4VWtvQ5HBh2RyA7mUHPwo6XMfocQtomKqKEktFmYEqrojWhpRaTXSMslTuKyXiMIWcgTDr0nRvYuUsuGR0 May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: 3e697bfab5ea482583276af140f451c2 May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2069154498 May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:16:21.547168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:16:21.548761 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3e697bfab5ea482583276af140f451c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3e697bfab5ea482583276af140f451c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3e697bfab5ea482583276af140f451c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3e697bfab5ea482583276af140f451c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:16:21.548761 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2069154498 May 16 19:16:21.548761 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: 3e697bfab5ea482583276af140f451c2 May 16 19:16:21.548761 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2069154498 May 16 19:16:21.548761 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-VolumesSnapshotsTestJSON-2069154498-project May 16 19:16:21.548761 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:16:21.548761 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:16:21.548761 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 5e317eec8c124eeaa373cdc1c4da1718 May 16 19:16:21.548761 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2069154498-project May 16 19:16:21.548761 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: May 16 19:16:21.548761 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. May 16 19:16:21.548761 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': 'b3ec5042-1cc1-4017-9821-53dc89101e43'} May 16 19:16:21.548761 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. (HTTP 404) (Request-ID: req-b2a00902-5f6f-4f1c-8135-854d61ea651b) May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:21.549666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 19:16:21.551041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 19:16:21.552544 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:16:21.554028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. May 16 19:16:21.554028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:21.554028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:21.554028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:21.554028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:21.554028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:21.554028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:21.554028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:16:21.554028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:16:21.554028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. May 16 19:16:21.554028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:21.554028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ffd534a4-8ada-42e1-a4fb-e50a251e910e tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] Returning 404 to user: Volume b3ec5042-1cc1-4017-9821-53dc89101e43 could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:16:21.554028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ffd534a4-8ada-42e1-a4fb-e50a251e910e tempest-VolumesSnapshotsTestJSON-2069154498 tempest-VolumesSnapshotsTestJSON-2069154498-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43" status: 404 len: 109 microversion: 2.1 time: 0.035245 May 16 19:16:21.554028 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 541/1124] 10.222.0.24 () {58 vars in 1244 bytes} [Mon May 16 19:16:21 2022] GET /compute/v2.1/os-volumes/b3ec5042-1cc1-4017-9821-53dc89101e43 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:16:23.048900 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4aa94b9e-8edb-403c-b429-ffc1a9d109d9 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Action: 'create', calling method: .version_select at 0x7f1e19014700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1022306851", "metadata": {"Type": "work"}}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4aa94b9e-8edb-403c-b429-ffc1a9d109d9 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Request method failure captured: May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 122 May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqMG1Z3qONSKFS10QaE_uFlMUP1j4hEPcDNiAWSus2R4Nabf_E5rEbqTf55vy-8KCQTADsB9pk9KeD9g01GyC-ItoiqchHRhDOE_dpyn1YiOd8oe8Q_gfSeneugoSOLRtfxzzTqm7MtHaaSro5lSASUbfwFCYiiV9z_Zdv_tK6o6lL4 May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: 9671884943cf42bf9541d827ecc2e42c May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:16:23.075932 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:16:23.077554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:16:23.077554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.077554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: 9671884943cf42bf9541d827ecc2e42c May 16 19:16:23.077554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.077554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-VolumesNegativeTest-1707771265-project May 16 19:16:23.077554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:16:23.077554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:16:23.077554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 0feaeb1c2f0148988cb4ad5f10a7b958 May 16 19:16:23.077554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-VolumesNegativeTest-1707771265-project May 16 19:16:23.077554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: May 16 19:16:23.077554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1022306851", "metadata": {"Type": "work"}}} May 16 19:16:23.077554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: May 16 19:16:23.077554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1022306851', 'metadata': {'Type': 'work'}}}} May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise error May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi '#$%' May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:16:23.078507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 19:16:23.080655 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 19:16:23.082400 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 19:16:23.082400 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.082400 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-4aa94b9e-8edb-403c-b429-ffc1a9d109d9 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:16:23.082400 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-4aa94b9e-8edb-403c-b429-ffc1a9d109d9 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.245653 May 16 19:16:23.082400 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 584/1125] 10.222.0.24 () {60 vars in 1155 bytes} [Mon May 16 19:16:22 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 19:16:23.088598 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1843f42f-3a33-4c05-b6ac-023a7ab34d30 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Action: 'create', calling method: .version_select at 0x7f1e0be87430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-468658187", "metadata": {"Type": "work"}}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1843f42f-3a33-4c05-b6ac-023a7ab34d30 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Request method failure captured: May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 119 May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqMG1Z3qONSKFS10QaE_uFlMUP1j4hEPcDNiAWSus2R4Nabf_E5rEbqTf55vy-8KCQTADsB9pk9KeD9g01GyC-ItoiqchHRhDOE_dpyn1YiOd8oe8Q_gfSeneugoSOLRtfxzzTqm7MtHaaSro5lSASUbfwFCYiiV9z_Zdv_tK6o6lL4 May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: 9671884943cf42bf9541d827ecc2e42c May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:16:23.091894 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:16:23.093457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:16:23.093457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.093457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: 9671884943cf42bf9541d827ecc2e42c May 16 19:16:23.093457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.093457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-VolumesNegativeTest-1707771265-project May 16 19:16:23.093457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:16:23.093457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:16:23.093457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 0feaeb1c2f0148988cb4ad5f10a7b958 May 16 19:16:23.093457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-VolumesNegativeTest-1707771265-project May 16 19:16:23.093457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: May 16 19:16:23.093457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-468658187", "metadata": {"Type": "work"}}} May 16 19:16:23.093457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: May 16 19:16:23.093457 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-468658187', 'metadata': {'Type': 'work'}}}} May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise error May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi '0' May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:16:23.094628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 19:16:23.096515 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 19:16:23.098063 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 19:16:23.098063 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.098063 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1843f42f-3a33-4c05-b6ac-023a7ab34d30 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:16:23.098063 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1843f42f-3a33-4c05-b6ac-023a7ab34d30 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009952 May 16 19:16:23.098803 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 542/1126] 10.222.0.24 () {60 vars in 1155 bytes} [Mon May 16 19:16:23 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 19:16:23.102854 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-99e4d859-2ab3-4d4c-9e58-453252dd251f tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Action: 'create', calling method: .version_select at 0x7f1e191ead30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-125812052", "metadata": {"Type": "work"}}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-99e4d859-2ab3-4d4c-9e58-453252dd251f tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Request method failure captured: May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 118 May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqMG1Z3qONSKFS10QaE_uFlMUP1j4hEPcDNiAWSus2R4Nabf_E5rEbqTf55vy-8KCQTADsB9pk9KeD9g01GyC-ItoiqchHRhDOE_dpyn1YiOd8oe8Q_gfSeneugoSOLRtfxzzTqm7MtHaaSro5lSASUbfwFCYiiV9z_Zdv_tK6o6lL4 May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: 9671884943cf42bf9541d827ecc2e42c May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:16:23.105144 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:16:23.106856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:16:23.106856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.106856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: 9671884943cf42bf9541d827ecc2e42c May 16 19:16:23.106856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.106856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-VolumesNegativeTest-1707771265-project May 16 19:16:23.106856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:16:23.106856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:16:23.106856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 0feaeb1c2f0148988cb4ad5f10a7b958 May 16 19:16:23.106856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-VolumesNegativeTest-1707771265-project May 16 19:16:23.106856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: May 16 19:16:23.106856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-125812052", "metadata": {"Type": "work"}}} May 16 19:16:23.106856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: May 16 19:16:23.106856 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-125812052', 'metadata': {'Type': 'work'}}}} May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise error May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi '' May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:16:23.107844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 19:16:23.109627 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 19:16:23.111084 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 19:16:23.111084 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.111084 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-99e4d859-2ab3-4d4c-9e58-453252dd251f tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:16:23.111084 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-99e4d859-2ab3-4d4c-9e58-453252dd251f tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007716 May 16 19:16:23.111084 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 585/1127] 10.222.0.24 () {60 vars in 1155 bytes} [Mon May 16 19:16:23 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 16 19:16:23.116670 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ed72d03b-63c9-478a-beb8-ed5a4b3affad tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Calling method '.version_select at 0x7f1e0be29c10>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:23.144510 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-ed72d03b-63c9-478a-beb8-ed5a4b3affad tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] HTTP exception thrown: Volume tempest-invalid-26882265 could not be found. May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ed72d03b-63c9-478a-beb8-ed5a4b3affad tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Request method failure captured: May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-26882265 HTTP/1.1 May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqMG1Z3qONSKFS10QaE_uFlMUP1j4hEPcDNiAWSus2R4Nabf_E5rEbqTf55vy-8KCQTADsB9pk9KeD9g01GyC-ItoiqchHRhDOE_dpyn1YiOd8oe8Q_gfSeneugoSOLRtfxzzTqm7MtHaaSro5lSASUbfwFCYiiV9z_Zdv_tK6o6lL4 May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: 9671884943cf42bf9541d827ecc2e42c May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:16:23.146606 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:16:23.148130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:16:23.148130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.148130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: 9671884943cf42bf9541d827ecc2e42c May 16 19:16:23.148130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.148130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-VolumesNegativeTest-1707771265-project May 16 19:16:23.148130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:16:23.148130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:16:23.148130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 0feaeb1c2f0148988cb4ad5f10a7b958 May 16 19:16:23.148130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-VolumesNegativeTest-1707771265-project May 16 19:16:23.148130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: May 16 19:16:23.148130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Volume tempest-invalid-26882265 could not be found. May 16 19:16:23.148130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': 'tempest-invalid-26882265'} May 16 19:16:23.148130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-26882265 could not be found. (HTTP 404) (Request-ID: req-f122b405-0da1-415c-8a78-023e9e6f2b5a) May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:23.148976 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 19:16:23.150188 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-26882265 could not be found. May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:16:23.151492 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-26882265 could not be found. May 16 19:16:23.152732 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.152732 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:23.152732 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.152732 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.152732 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:23.152732 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:23.152732 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:16:23.152732 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:16:23.152732 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-26882265 could not be found. May 16 19:16:23.152732 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.152732 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ed72d03b-63c9-478a-beb8-ed5a4b3affad tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Returning 404 to user: Volume tempest-invalid-26882265 could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:16:23.152732 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ed72d03b-63c9-478a-beb8-ed5a4b3affad tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/tempest-invalid-26882265" status: 404 len: 97 microversion: 2.1 time: 0.036014 May 16 19:16:23.152732 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 543/1128] 10.222.0.24 () {58 vars in 1211 bytes} [Mon May 16 19:16:23 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-26882265 => generated 97 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 16 19:16:23.159200 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-57dc7a90-e8a9-49b1-a5b0-7dde16376465 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004647 May 16 19:16:23.164802 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 586/1129] 10.222.0.24 () {58 vars in 1139 bytes} [Mon May 16 19:16:23 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 16 19:16:23.172555 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b126213c-2833-4ce9-9645-115a2df2e999 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006260 May 16 19:16:23.173075 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 544/1130] 10.222.0.24 () {58 vars in 1136 bytes} [Mon May 16 19:16:23 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 16 19:16:23.185599 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-61d21d9b-caa3-4237-91ac-c2a78f2415c0 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Calling method '.version_select at 0x7f1e191ea790>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:23.219547 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-61d21d9b-caa3-4237-91ac-c2a78f2415c0 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] HTTP exception thrown: Volume 26000a6a-b0ba-44b1-9eae-902c26033e49 could not be found. May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-61d21d9b-caa3-4237-91ac-c2a78f2415c0 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Request method failure captured: May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: DELETE /compute/v2.1/os-volumes/26000a6a-b0ba-44b1-9eae-902c26033e49 HTTP/1.1 May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqMG1Z3qONSKFS10QaE_uFlMUP1j4hEPcDNiAWSus2R4Nabf_E5rEbqTf55vy-8KCQTADsB9pk9KeD9g01GyC-ItoiqchHRhDOE_dpyn1YiOd8oe8Q_gfSeneugoSOLRtfxzzTqm7MtHaaSro5lSASUbfwFCYiiV9z_Zdv_tK6o6lL4 May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: 9671884943cf42bf9541d827ecc2e42c May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:16:23.221504 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:16:23.223153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:16:23.223153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.223153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: 9671884943cf42bf9541d827ecc2e42c May 16 19:16:23.223153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.223153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-VolumesNegativeTest-1707771265-project May 16 19:16:23.223153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:16:23.223153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:16:23.223153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 0feaeb1c2f0148988cb4ad5f10a7b958 May 16 19:16:23.223153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-VolumesNegativeTest-1707771265-project May 16 19:16:23.223153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: May 16 19:16:23.223153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Volume 26000a6a-b0ba-44b1-9eae-902c26033e49 could not be found. May 16 19:16:23.223153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': '26000a6a-b0ba-44b1-9eae-902c26033e49'} May 16 19:16:23.223153 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 26000a6a-b0ba-44b1-9eae-902c26033e49 could not be found. (HTTP 404) (Request-ID: req-61d37295-5679-4166-aae4-a52326f14f50) May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:23.224120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 19:16:23.225610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 26000a6a-b0ba-44b1-9eae-902c26033e49 could not be found. May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 19:16:23.226988 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:16:23.228971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 26000a6a-b0ba-44b1-9eae-902c26033e49 could not be found. May 16 19:16:23.228971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.228971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:23.228971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.228971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.228971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:23.228971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:23.228971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:16:23.228971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:16:23.228971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 26000a6a-b0ba-44b1-9eae-902c26033e49 could not be found. May 16 19:16:23.228971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:16:23.228971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-61d21d9b-caa3-4237-91ac-c2a78f2415c0 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Returning 404 to user: Volume 26000a6a-b0ba-44b1-9eae-902c26033e49 could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:16:23.228971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-61d21d9b-caa3-4237-91ac-c2a78f2415c0 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/26000a6a-b0ba-44b1-9eae-902c26033e49" status: 404 len: 109 microversion: 2.1 time: 0.043628 May 16 19:16:23.228971 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 587/1131] 10.222.0.24 () {58 vars in 1247 bytes} [Mon May 16 19:16:23 2022] DELETE /compute/v2.1/os-volumes/26000a6a-b0ba-44b1-9eae-902c26033e49 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:16:23.240358 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c5a201bf-7314-4b19-9f37-00467f0f2af9 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Calling method '.version_select at 0x7f1e0bc4cee0>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:23.267887 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-c5a201bf-7314-4b19-9f37-00467f0f2af9 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] HTTP exception thrown: Volume 5327f32f-9fe7-41fe-8080-2956dea5868f could not be found. May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c5a201bf-7314-4b19-9f37-00467f0f2af9 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Request method failure captured: May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/os-volumes/5327f32f-9fe7-41fe-8080-2956dea5868f HTTP/1.1 May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqMG1Z3qONSKFS10QaE_uFlMUP1j4hEPcDNiAWSus2R4Nabf_E5rEbqTf55vy-8KCQTADsB9pk9KeD9g01GyC-ItoiqchHRhDOE_dpyn1YiOd8oe8Q_gfSeneugoSOLRtfxzzTqm7MtHaaSro5lSASUbfwFCYiiV9z_Zdv_tK6o6lL4 May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: 9671884943cf42bf9541d827ecc2e42c May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:16:23.269999 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:16:23.271576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_9671884943cf42bf9541d827ecc2e42c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:16:23.271576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.271576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: 9671884943cf42bf9541d827ecc2e42c May 16 19:16:23.271576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-VolumesNegativeTest-1707771265 May 16 19:16:23.271576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-VolumesNegativeTest-1707771265-project May 16 19:16:23.271576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:16:23.271576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:16:23.271576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 0feaeb1c2f0148988cb4ad5f10a7b958 May 16 19:16:23.271576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-VolumesNegativeTest-1707771265-project May 16 19:16:23.271576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: May 16 19:16:23.271576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Volume 5327f32f-9fe7-41fe-8080-2956dea5868f could not be found. May 16 19:16:23.271576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': '5327f32f-9fe7-41fe-8080-2956dea5868f'} May 16 19:16:23.271576 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5327f32f-9fe7-41fe-8080-2956dea5868f could not be found. (HTTP 404) (Request-ID: req-56f616ec-3f13-4e04-b12d-5ec1917215d2) May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:23.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 19:16:23.274294 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5327f32f-9fe7-41fe-8080-2956dea5868f could not be found. May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 19:16:23.275903 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:16:23.278146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5327f32f-9fe7-41fe-8080-2956dea5868f could not be found. May 16 19:16:23.278146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.278146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:23.278146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.278146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:23.278146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:23.278146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:23.278146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:16:23.278146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:16:23.278146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5327f32f-9fe7-41fe-8080-2956dea5868f could not be found. May 16 19:16:23.278146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:23.278146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-c5a201bf-7314-4b19-9f37-00467f0f2af9 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] Returning 404 to user: Volume 5327f32f-9fe7-41fe-8080-2956dea5868f could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:16:23.278146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-c5a201bf-7314-4b19-9f37-00467f0f2af9 tempest-VolumesNegativeTest-1707771265 tempest-VolumesNegativeTest-1707771265-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/5327f32f-9fe7-41fe-8080-2956dea5868f" status: 404 len: 109 microversion: 2.1 time: 0.035064 May 16 19:16:23.278146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 545/1132] 10.222.0.24 () {58 vars in 1244 bytes} [Mon May 16 19:16:23 2022] GET /compute/v2.1/os-volumes/5327f32f-9fe7-41fe-8080-2956dea5868f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:16:29.156582 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-dbb868c1-386f-47df-a293-c91e2fa0e15e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:29.157218 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-dbb868c1-386f-47df-a293-c91e2fa0e15e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:29.165838 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dbb868c1-386f-47df-a293-c91e2fa0e15e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:29.166215 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dbb868c1-386f-47df-a293-c91e2fa0e15e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:29.166987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dbb868c1-386f-47df-a293-c91e2fa0e15e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:29.167412 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dbb868c1-386f-47df-a293-c91e2fa0e15e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:29.192937 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-dbb868c1-386f-47df-a293-c91e2fa0e15e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Going to try to terminate instance {{(pid=117274) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:16:29.268772 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-dbb868c1-386f-47df-a293-c91e2fa0e15e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 204 len: 0 microversion: 2.1 time: 0.116490 May 16 19:16:29.272616 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 588/1133] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:16:29 2022] DELETE /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 19:16:29.278779 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1ae56cf7-8cda-405e-841d-69a8ef972ea7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:29.279392 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1ae56cf7-8cda-405e-841d-69a8ef972ea7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:29.287202 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1ae56cf7-8cda-405e-841d-69a8ef972ea7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:29.288241 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1ae56cf7-8cda-405e-841d-69a8ef972ea7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:29.289571 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1ae56cf7-8cda-405e-841d-69a8ef972ea7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:29.290384 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1ae56cf7-8cda-405e-841d-69a8ef972ea7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:29.423967 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1ae56cf7-8cda-405e-841d-69a8ef972ea7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:29.431498 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1ae56cf7-8cda-405e-841d-69a8ef972ea7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1576 microversion: 2.1 time: 0.157538 May 16 19:16:29.432074 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 546/1134] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:29 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 19:16:30.449793 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-2e99b69c-552d-460b-a3ee-8686e066605e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:30.451200 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-2e99b69c-552d-460b-a3ee-8686e066605e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:30.458835 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2e99b69c-552d-460b-a3ee-8686e066605e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:30.459632 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2e99b69c-552d-460b-a3ee-8686e066605e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:30.460786 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2e99b69c-552d-460b-a3ee-8686e066605e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:30.461335 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-2e99b69c-552d-460b-a3ee-8686e066605e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:30.596296 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-2e99b69c-552d-460b-a3ee-8686e066605e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:30.603785 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-2e99b69c-552d-460b-a3ee-8686e066605e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1576 microversion: 2.1 time: 0.158689 May 16 19:16:30.604350 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 589/1135] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:30 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:31.615568 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-294e732a-ae7c-480d-9d9b-dcfb5846d519 req-69a1426a-7f45-4698-9394-f2058fb9da71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3e480e-c9ee-46ba-8393-c289b3fee9eb", "name": "network-vif-deleted", "tag": "b4806342-52fb-4a7f-bc66-ac85ae8e8213"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:16:31.621613 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-fe517a7a-575c-4dc3-b86c-ac98b2cefa8d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:31.622395 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-fe517a7a-575c-4dc3-b86c-ac98b2cefa8d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:31.630421 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fe517a7a-575c-4dc3-b86c-ac98b2cefa8d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:31.631120 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fe517a7a-575c-4dc3-b86c-ac98b2cefa8d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:31.632100 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fe517a7a-575c-4dc3-b86c-ac98b2cefa8d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:31.632868 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fe517a7a-575c-4dc3-b86c-ac98b2cefa8d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:31.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-294e732a-ae7c-480d-9d9b-dcfb5846d519 req-69a1426a-7f45-4698-9394-f2058fb9da71 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:31.635552 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-294e732a-ae7c-480d-9d9b-dcfb5846d519 req-69a1426a-7f45-4698-9394-f2058fb9da71 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:31.662525 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-294e732a-ae7c-480d-9d9b-dcfb5846d519 req-69a1426a-7f45-4698-9394-f2058fb9da71 service nova] Creating event network-vif-deleted:b4806342-52fb-4a7f-bc66-ac85ae8e8213 for instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb on hv-cinder-76606 May 16 19:16:31.684393 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-294e732a-ae7c-480d-9d9b-dcfb5846d519 req-69a1426a-7f45-4698-9394-f2058fb9da71 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072568 May 16 19:16:31.685405 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 547/1136] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:16:31.707977 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-fe517a7a-575c-4dc3-b86c-ac98b2cefa8d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:31.717118 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-fe517a7a-575c-4dc3-b86c-ac98b2cefa8d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1225 microversion: 2.1 time: 0.099329 May 16 19:16:31.717757 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 590/1137] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:31 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:32.734782 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-14afb7e6-c528-4e55-a435-d6bc32817d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:32.735481 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-14afb7e6-c528-4e55-a435-d6bc32817d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:32.742219 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-14afb7e6-c528-4e55-a435-d6bc32817d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:32.742666 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-14afb7e6-c528-4e55-a435-d6bc32817d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:32.743440 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-14afb7e6-c528-4e55-a435-d6bc32817d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:32.743864 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-14afb7e6-c528-4e55-a435-d6bc32817d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:32.776701 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-14afb7e6-c528-4e55-a435-d6bc32817d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:32.777066 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-14afb7e6-c528-4e55-a435-d6bc32817d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:32.777517 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.objects.instance [None req-14afb7e6-c528-4e55-a435-d6bc32817d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lazy-loading 'fault' on Instance uuid 9b3e480e-c9ee-46ba-8393-c289b3fee9eb {{(pid=117275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:16:32.818874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-14afb7e6-c528-4e55-a435-d6bc32817d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:32.826745 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-14afb7e6-c528-4e55-a435-d6bc32817d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1230 microversion: 2.1 time: 0.096825 May 16 19:16:32.827293 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 548/1138] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:32 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:33.848184 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-0384d5cd-7780-42a8-b0e7-0e3b9a096e7a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:33.849202 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-0384d5cd-7780-42a8-b0e7-0e3b9a096e7a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:33.860029 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0384d5cd-7780-42a8-b0e7-0e3b9a096e7a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:33.860759 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0384d5cd-7780-42a8-b0e7-0e3b9a096e7a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:33.861561 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0384d5cd-7780-42a8-b0e7-0e3b9a096e7a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:33.862032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0384d5cd-7780-42a8-b0e7-0e3b9a096e7a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:33.893004 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0384d5cd-7780-42a8-b0e7-0e3b9a096e7a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:33.893456 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-0384d5cd-7780-42a8-b0e7-0e3b9a096e7a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:33.893922 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-0384d5cd-7780-42a8-b0e7-0e3b9a096e7a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lazy-loading 'fault' on Instance uuid 9b3e480e-c9ee-46ba-8393-c289b3fee9eb {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:16:33.934968 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-0384d5cd-7780-42a8-b0e7-0e3b9a096e7a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:33.942552 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-0384d5cd-7780-42a8-b0e7-0e3b9a096e7a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 200 len: 1230 microversion: 2.1 time: 0.101120 May 16 19:16:33.943115 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 591/1139] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:33 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:34.959025 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b6834259-515a-4d94-9c2a-76e79eb0f54c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:34.959611 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b6834259-515a-4d94-9c2a-76e79eb0f54c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:34.965885 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b6834259-515a-4d94-9c2a-76e79eb0f54c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:34.966333 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b6834259-515a-4d94-9c2a-76e79eb0f54c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:34.967100 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b6834259-515a-4d94-9c2a-76e79eb0f54c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:34.967547 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b6834259-515a-4d94-9c2a-76e79eb0f54c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:34.981259 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-b6834259-515a-4d94-9c2a-76e79eb0f54c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] HTTP exception thrown: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b6834259-515a-4d94-9c2a-76e79eb0f54c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Request method failure captured: May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb HTTP/1.1 May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqJf3RbHQYJhmEptKp0cS0QguIxgNpF161dv1ZMYhO7NnbLclJBZ8JyvVydLvuEe0Bt0rjKelXzGJkrgFrx-L6AK9uLlS4H6jbcsmD5GSJP7ikjeTqYhpbhwhn1ujqcJC65gj-9zdrNvI0_fQlah583iAhEi71CSp_RyTQ5llGG6lys May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: 385ae3c7ea8347d7bfc346d8bc7fda4a May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-TestVolumeBootPattern-1099673589 May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:16:34.983590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:16:34.985461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:16:34.985461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-TestVolumeBootPattern-1099673589 May 16 19:16:34.985461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: 385ae3c7ea8347d7bfc346d8bc7fda4a May 16 19:16:34.985461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-TestVolumeBootPattern-1099673589 May 16 19:16:34.985461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-TestVolumeBootPattern-1099673589-project May 16 19:16:34.985461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:16:34.985461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:16:34.985461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 64634c902a884b84a8bd2d3c10ce6270 May 16 19:16:34.985461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-TestVolumeBootPattern-1099673589-project May 16 19:16:34.985461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:16:34.985461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. May 16 19:16:34.985461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': '9b3e480e-c9ee-46ba-8393-c289b3fee9eb'} May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:16:34.986482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. May 16 19:16:34.988054 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:16:34.989452 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b6834259-515a-4d94-9c2a-76e79eb0f54c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Returning 404 to user: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:16:34.989452 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b6834259-515a-4d94-9c2a-76e79eb0f54c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 404 len: 111 microversion: 2.1 time: 0.029946 May 16 19:16:34.989452 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 549/1140] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:34 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:16:35.087236 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-34f52b5e-55d2-415c-bedf-9967236aaca8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-702896543", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1176123874", "security_groups": [{"name": "tempest-secgroup-smoke-33929672"}], "block_device_mapping_v2": [{"uuid": "4a364c5f-d6c8-49a3-8898-37611f119507", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "76a0db38-1a09-4cf8-86ec-0bf0b9de76ec"}]}} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:16:35.202189 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.network.neutron [None req-34f52b5e-55d2-415c-bedf-9967236aaca8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] validate_networks() for [('76a0db38-1a09-4cf8-86ec-0bf0b9de76ec', None, None, None, None, None)] {{(pid=117274) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:16:35.571321 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-34f52b5e-55d2-415c-bedf-9967236aaca8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Flavor limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:16:35.571744 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-34f52b5e-55d2-415c-bedf-9967236aaca8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Image limits 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:16:35.572276 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-34f52b5e-55d2-415c-bedf-9967236aaca8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Flavor pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:16:35.572701 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-34f52b5e-55d2-415c-bedf-9967236aaca8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Image pref 0:0:0 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:16:35.573114 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.virt.hardware [None req-34f52b5e-55d2-415c-bedf-9967236aaca8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:16:35.581827 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-34f52b5e-55d2-415c-bedf-9967236aaca8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:35.582273 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-34f52b5e-55d2-415c-bedf-9967236aaca8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:35.583079 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-34f52b5e-55d2-415c-bedf-9967236aaca8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:35.583515 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-34f52b5e-55d2-415c-bedf-9967236aaca8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:35.599868 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-34f52b5e-55d2-415c-bedf-9967236aaca8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Getting quotas for project 385ae3c7ea8347d7bfc346d8bc7fda4a. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:16:35.603710 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.quota [None req-34f52b5e-55d2-415c-bedf-9967236aaca8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Getting quotas for user 64634c902a884b84a8bd2d3c10ce6270 and project 385ae3c7ea8347d7bfc346d8bc7fda4a. Resources: {'cores', 'instances', 'ram'} {{(pid=117274) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:16:35.659840 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-34f52b5e-55d2-415c-bedf-9967236aaca8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Going to run 1 instances... {{(pid=117274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:16:35.661960 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-34f52b5e-55d2-415c-bedf-9967236aaca8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a364c5f-d6c8-49a3-8898-37611f119507',volume_size=None,volume_type=None)] {{(pid=117274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:16:35.791345 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-34f52b5e-55d2-415c-bedf-9967236aaca8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.708018 May 16 19:16:35.792294 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 592/1141] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:16:35 2022] POST /compute/v2.1/servers => generated 404 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:16:35.802196 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-0f66e53c-15fa-4149-9c1c-2e26dcca35b1 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:35.802818 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-0f66e53c-15fa-4149-9c1c-2e26dcca35b1 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:35.859220 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-0f66e53c-15fa-4149-9c1c-2e26dcca35b1 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:35.866074 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-0f66e53c-15fa-4149-9c1c-2e26dcca35b1 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1094 microversion: 2.1 time: 0.067618 May 16 19:16:35.875208 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 550/1142] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:35 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:36.883990 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-da79ff28-de8d-465c-ad0a-a042403d8992 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:36.885312 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-da79ff28-de8d-465c-ad0a-a042403d8992 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:36.894842 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-da79ff28-de8d-465c-ad0a-a042403d8992 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:36.894842 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-da79ff28-de8d-465c-ad0a-a042403d8992 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:36.895893 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-da79ff28-de8d-465c-ad0a-a042403d8992 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:36.896430 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-da79ff28-de8d-465c-ad0a-a042403d8992 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:36.967841 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-da79ff28-de8d-465c-ad0a-a042403d8992 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:36.976251 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-da79ff28-de8d-465c-ad0a-a042403d8992 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1210 microversion: 2.1 time: 0.097201 May 16 19:16:36.977599 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 593/1143] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:36 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:37.993835 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-408b4e31-1462-4b24-9e09-558bd47b4872 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:37.994427 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-408b4e31-1462-4b24-9e09-558bd47b4872 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:38.004500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-408b4e31-1462-4b24-9e09-558bd47b4872 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:38.005010 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-408b4e31-1462-4b24-9e09-558bd47b4872 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:38.006158 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-408b4e31-1462-4b24-9e09-558bd47b4872 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:38.006928 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-408b4e31-1462-4b24-9e09-558bd47b4872 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:38.204635 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-408b4e31-1462-4b24-9e09-558bd47b4872 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:38.212387 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-408b4e31-1462-4b24-9e09-558bd47b4872 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1264 microversion: 2.1 time: 0.222593 May 16 19:16:38.213089 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 551/1144] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:37 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:38.309032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [req-f783f715-eda2-4308-bea1-e16aa25d44dd req-af0c8670-b481-4055-8e25-11d6db2de2bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55dfa22e-8502-4ec3-908d-a2315cd2c23d", "tag": "5ae7f641-8210-4168-952a-e6c7ee9608d0"}]} {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:16:38.324021 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-f783f715-eda2-4308-bea1-e16aa25d44dd req-af0c8670-b481-4055-8e25-11d6db2de2bc service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:38.324613 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [req-f783f715-eda2-4308-bea1-e16aa25d44dd req-af0c8670-b481-4055-8e25-11d6db2de2bc service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:38.339937 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.compute.server_external_events [req-f783f715-eda2-4308-bea1-e16aa25d44dd req-af0c8670-b481-4055-8e25-11d6db2de2bc service nova] Creating event network-changed:5ae7f641-8210-4168-952a-e6c7ee9608d0 for instance 55dfa22e-8502-4ec3-908d-a2315cd2c23d on hv-cinder-76606 May 16 19:16:38.346048 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [req-f783f715-eda2-4308-bea1-e16aa25d44dd req-af0c8670-b481-4055-8e25-11d6db2de2bc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040978 May 16 19:16:38.348025 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 594/1145] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:16:39.232977 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-635d5411-4e46-474c-9963-d6af1222eb55 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:39.233845 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-635d5411-4e46-474c-9963-d6af1222eb55 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:39.244261 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-635d5411-4e46-474c-9963-d6af1222eb55 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:39.244975 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-635d5411-4e46-474c-9963-d6af1222eb55 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:39.246265 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-635d5411-4e46-474c-9963-d6af1222eb55 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:39.246874 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-635d5411-4e46-474c-9963-d6af1222eb55 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:39.378473 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-635d5411-4e46-474c-9963-d6af1222eb55 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:39.386846 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-635d5411-4e46-474c-9963-d6af1222eb55 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1264 microversion: 2.1 time: 0.160240 May 16 19:16:39.387414 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 552/1146] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:39 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:40.409830 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-1d08fe7c-3b5d-4488-9412-112d5b41b2e0 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:40.411059 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-1d08fe7c-3b5d-4488-9412-112d5b41b2e0 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:40.421948 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1d08fe7c-3b5d-4488-9412-112d5b41b2e0 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:40.422824 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1d08fe7c-3b5d-4488-9412-112d5b41b2e0 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:40.423608 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1d08fe7c-3b5d-4488-9412-112d5b41b2e0 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:40.424044 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-1d08fe7c-3b5d-4488-9412-112d5b41b2e0 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:40.554797 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-1d08fe7c-3b5d-4488-9412-112d5b41b2e0 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:40.562639 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-1d08fe7c-3b5d-4488-9412-112d5b41b2e0 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1264 microversion: 2.1 time: 0.160729 May 16 19:16:40.563206 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 595/1147] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:40 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:41.580029 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-49459173-6852-4c8a-865f-d8546d2cdbea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:41.580979 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-49459173-6852-4c8a-865f-d8546d2cdbea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:41.587900 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-49459173-6852-4c8a-865f-d8546d2cdbea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:41.588339 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-49459173-6852-4c8a-865f-d8546d2cdbea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:41.589107 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-49459173-6852-4c8a-865f-d8546d2cdbea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:41.589553 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-49459173-6852-4c8a-865f-d8546d2cdbea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:41.817590 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-49459173-6852-4c8a-865f-d8546d2cdbea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:41.834083 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-49459173-6852-4c8a-865f-d8546d2cdbea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1264 microversion: 2.1 time: 0.254051 May 16 19:16:41.834822 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 553/1148] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:41 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1264 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:42.852575 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-c71bb76b-91ab-4906-adad-ebec83bf7265 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:42.853185 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-c71bb76b-91ab-4906-adad-ebec83bf7265 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:42.860194 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c71bb76b-91ab-4906-adad-ebec83bf7265 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:42.860641 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c71bb76b-91ab-4906-adad-ebec83bf7265 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:42.861411 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c71bb76b-91ab-4906-adad-ebec83bf7265 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:42.861907 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-c71bb76b-91ab-4906-adad-ebec83bf7265 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:42.997203 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-c71bb76b-91ab-4906-adad-ebec83bf7265 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:43.005065 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-c71bb76b-91ab-4906-adad-ebec83bf7265 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1264 microversion: 2.1 time: 0.156516 May 16 19:16:43.005643 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 596/1149] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:42 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:44.023584 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ae2035ac-ea6b-4c56-977c-e1f3df08d8aa tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:44.029792 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ae2035ac-ea6b-4c56-977c-e1f3df08d8aa tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:44.038500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ae2035ac-ea6b-4c56-977c-e1f3df08d8aa tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:44.039037 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ae2035ac-ea6b-4c56-977c-e1f3df08d8aa tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:44.040170 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ae2035ac-ea6b-4c56-977c-e1f3df08d8aa tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:44.040728 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ae2035ac-ea6b-4c56-977c-e1f3df08d8aa tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:44.176527 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ae2035ac-ea6b-4c56-977c-e1f3df08d8aa tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:44.189283 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ae2035ac-ea6b-4c56-977c-e1f3df08d8aa tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1264 microversion: 2.1 time: 0.170713 May 16 19:16:44.189909 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 554/1150] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:44 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:45.206844 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-62481e0f-82fc-47cd-89a9-ab526b194c12 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:45.207537 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-62481e0f-82fc-47cd-89a9-ab526b194c12 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:45.215498 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-62481e0f-82fc-47cd-89a9-ab526b194c12 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:45.216032 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-62481e0f-82fc-47cd-89a9-ab526b194c12 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:45.216949 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-62481e0f-82fc-47cd-89a9-ab526b194c12 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:45.217459 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-62481e0f-82fc-47cd-89a9-ab526b194c12 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:45.357913 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-62481e0f-82fc-47cd-89a9-ab526b194c12 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:45.369492 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-62481e0f-82fc-47cd-89a9-ab526b194c12 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1264 microversion: 2.1 time: 0.167310 May 16 19:16:45.370083 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 597/1151] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:45 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:46.394265 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-80916814-029f-4cea-83d3-cdce127779eb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:46.395279 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-80916814-029f-4cea-83d3-cdce127779eb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:46.402811 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-80916814-029f-4cea-83d3-cdce127779eb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:46.403260 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-80916814-029f-4cea-83d3-cdce127779eb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:46.404035 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-80916814-029f-4cea-83d3-cdce127779eb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:46.404483 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-80916814-029f-4cea-83d3-cdce127779eb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:46.535608 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-80916814-029f-4cea-83d3-cdce127779eb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:46.543438 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-80916814-029f-4cea-83d3-cdce127779eb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1264 microversion: 2.1 time: 0.156296 May 16 19:16:46.543972 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 555/1152] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:46 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:47.560977 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-14ab35fc-814d-4000-bae2-d027850e333e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:47.561557 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-14ab35fc-814d-4000-bae2-d027850e333e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:47.568468 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-14ab35fc-814d-4000-bae2-d027850e333e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:47.568890 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-14ab35fc-814d-4000-bae2-d027850e333e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:47.569690 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-14ab35fc-814d-4000-bae2-d027850e333e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:47.570121 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-14ab35fc-814d-4000-bae2-d027850e333e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:47.716203 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-14ab35fc-814d-4000-bae2-d027850e333e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:47.723875 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-14ab35fc-814d-4000-bae2-d027850e333e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1264 microversion: 2.1 time: 0.167152 May 16 19:16:47.724482 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 598/1153] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:47 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:48.740242 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-1ff1c34c-d650-4321-be74-768709440e62 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:48.740901 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-1ff1c34c-d650-4321-be74-768709440e62 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:48.747431 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1ff1c34c-d650-4321-be74-768709440e62 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:48.747890 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1ff1c34c-d650-4321-be74-768709440e62 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:48.748676 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1ff1c34c-d650-4321-be74-768709440e62 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:48.749433 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-1ff1c34c-d650-4321-be74-768709440e62 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:48.893541 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-1ff1c34c-d650-4321-be74-768709440e62 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:48.904119 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-1ff1c34c-d650-4321-be74-768709440e62 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1264 microversion: 2.1 time: 0.167519 May 16 19:16:48.904905 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 556/1154] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:48 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:49.925141 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ec426f76-fef5-46dd-98df-d30373a14efb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:49.926091 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ec426f76-fef5-46dd-98df-d30373a14efb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:49.935433 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec426f76-fef5-46dd-98df-d30373a14efb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:49.935873 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec426f76-fef5-46dd-98df-d30373a14efb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:49.936631 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec426f76-fef5-46dd-98df-d30373a14efb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:49.937059 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ec426f76-fef5-46dd-98df-d30373a14efb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:50.086861 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ec426f76-fef5-46dd-98df-d30373a14efb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:50.094679 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ec426f76-fef5-46dd-98df-d30373a14efb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1264 microversion: 2.1 time: 0.176174 May 16 19:16:50.095292 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 599/1155] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:49 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:50.769109 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-d6fc096a-faa9-4af5-95b6-c508359f6c2e req-f3623b95-cb72-4e19-a2d7-af2630be7960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55dfa22e-8502-4ec3-908d-a2315cd2c23d", "name": "network-vif-plugged", "status": "completed", "tag": "5ae7f641-8210-4168-952a-e6c7ee9608d0"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:16:50.778714 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-d6fc096a-faa9-4af5-95b6-c508359f6c2e req-f3623b95-cb72-4e19-a2d7-af2630be7960 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:50.779059 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-d6fc096a-faa9-4af5-95b6-c508359f6c2e req-f3623b95-cb72-4e19-a2d7-af2630be7960 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:50.793241 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-d6fc096a-faa9-4af5-95b6-c508359f6c2e req-f3623b95-cb72-4e19-a2d7-af2630be7960 service nova] Creating event network-vif-plugged:5ae7f641-8210-4168-952a-e6c7ee9608d0 for instance 55dfa22e-8502-4ec3-908d-a2315cd2c23d on hv-cinder-76606 May 16 19:16:50.798321 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-d6fc096a-faa9-4af5-95b6-c508359f6c2e req-f3623b95-cb72-4e19-a2d7-af2630be7960 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032941 May 16 19:16:50.798925 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 557/1156] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:16:51.111552 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e654ff4f-558a-403f-b167-f02ca867d246 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:51.112145 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e654ff4f-558a-403f-b167-f02ca867d246 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:51.118886 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e654ff4f-558a-403f-b167-f02ca867d246 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:51.119261 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e654ff4f-558a-403f-b167-f02ca867d246 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:51.120033 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e654ff4f-558a-403f-b167-f02ca867d246 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:51.120459 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e654ff4f-558a-403f-b167-f02ca867d246 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:51.250978 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e654ff4f-558a-403f-b167-f02ca867d246 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:51.259384 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e654ff4f-558a-403f-b167-f02ca867d246 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1264 microversion: 2.1 time: 0.151641 May 16 19:16:51.259978 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 600/1157] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:51 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:52.282783 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-d4417c17-647e-49a6-9847-7a485299ab90 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:52.283473 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-d4417c17-647e-49a6-9847-7a485299ab90 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:52.290407 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d4417c17-647e-49a6-9847-7a485299ab90 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:52.290865 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d4417c17-647e-49a6-9847-7a485299ab90 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:52.291794 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d4417c17-647e-49a6-9847-7a485299ab90 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:52.292957 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-d4417c17-647e-49a6-9847-7a485299ab90 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:52.430029 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-d4417c17-647e-49a6-9847-7a485299ab90 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:52.437917 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-d4417c17-647e-49a6-9847-7a485299ab90 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1451 microversion: 2.1 time: 0.161776 May 16 19:16:52.438461 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 558/1158] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:52 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:52.453987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7c99576d-7685-4fbb-ae83-44eb904d642d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:16:52.454656 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7c99576d-7685-4fbb-ae83-44eb904d642d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:16:52.463878 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7c99576d-7685-4fbb-ae83-44eb904d642d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:52.464520 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7c99576d-7685-4fbb-ae83-44eb904d642d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:52.465703 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7c99576d-7685-4fbb-ae83-44eb904d642d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:52.466337 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7c99576d-7685-4fbb-ae83-44eb904d642d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:52.610106 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7c99576d-7685-4fbb-ae83-44eb904d642d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:16:52.617758 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7c99576d-7685-4fbb-ae83-44eb904d642d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1451 microversion: 2.1 time: 0.167636 May 16 19:16:52.618366 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 601/1159] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:16:52 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:16:54.488812 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-9d22dfea-69cb-42fe-92f3-722981af67d7 req-4e5781e4-2762-477a-a077-65af8597c7df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55dfa22e-8502-4ec3-908d-a2315cd2c23d", "tag": "5ae7f641-8210-4168-952a-e6c7ee9608d0"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:16:54.497427 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-9d22dfea-69cb-42fe-92f3-722981af67d7 req-4e5781e4-2762-477a-a077-65af8597c7df service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:16:54.497895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-9d22dfea-69cb-42fe-92f3-722981af67d7 req-4e5781e4-2762-477a-a077-65af8597c7df service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:16:54.513968 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-9d22dfea-69cb-42fe-92f3-722981af67d7 req-4e5781e4-2762-477a-a077-65af8597c7df service nova] Creating event network-changed:5ae7f641-8210-4168-952a-e6c7ee9608d0 for instance 55dfa22e-8502-4ec3-908d-a2315cd2c23d on hv-cinder-76606 May 16 19:16:54.520425 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-9d22dfea-69cb-42fe-92f3-722981af67d7 req-4e5781e4-2762-477a-a077-65af8597c7df service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035325 May 16 19:16:54.521041 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 559/1160] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:17:02.965239 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-6e779d2b-2ecd-4eb2-b2f3-a2b31c38c0cf tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:17:02.965922 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-6e779d2b-2ecd-4eb2-b2f3-a2b31c38c0cf tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:17:02.967225 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-69d4915f-633c-4afe-846a-979699123ba6 req-3735acf6-dfa5-4aa5-bef3-a5b185442e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a385b0-58f3-4946-b6c6-2cbd20fe387f", "tag": "aadd3356-5374-4e27-aec5-d1a129d4438b"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:17:02.973006 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6e779d2b-2ecd-4eb2-b2f3-a2b31c38c0cf tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:17:02.973810 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6e779d2b-2ecd-4eb2-b2f3-a2b31c38c0cf tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:17:02.974763 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6e779d2b-2ecd-4eb2-b2f3-a2b31c38c0cf tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:17:02.975349 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-6e779d2b-2ecd-4eb2-b2f3-a2b31c38c0cf tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:17:02.978484 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-69d4915f-633c-4afe-846a-979699123ba6 req-3735acf6-dfa5-4aa5-bef3-a5b185442e37 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:17:02.979227 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-69d4915f-633c-4afe-846a-979699123ba6 req-3735acf6-dfa5-4aa5-bef3-a5b185442e37 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:17:02.995961 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-69d4915f-633c-4afe-846a-979699123ba6 req-3735acf6-dfa5-4aa5-bef3-a5b185442e37 service nova] Creating event network-changed:aadd3356-5374-4e27-aec5-d1a129d4438b for instance 96a385b0-58f3-4946-b6c6-2cbd20fe387f on hv-cinder-76606 May 16 19:17:03.002392 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-69d4915f-633c-4afe-846a-979699123ba6 req-3735acf6-dfa5-4aa5-bef3-a5b185442e37 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039943 May 16 19:17:03.003752 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 560/1161] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:17:03.005298 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-6e779d2b-2ecd-4eb2-b2f3-a2b31c38c0cf tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Going to try to terminate instance {{(pid=117274) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:17:03.108662 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-6e779d2b-2ecd-4eb2-b2f3-a2b31c38c0cf tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "DELETE /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 204 len: 0 microversion: 2.1 time: 0.147100 May 16 19:17:03.120817 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-e391e166-8dac-4fc0-a47c-12464cebab69 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:17:03.121547 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-e391e166-8dac-4fc0-a47c-12464cebab69 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:17:03.126586 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 602/1162] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:17:02 2022] DELETE /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 19:17:03.129062 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e391e166-8dac-4fc0-a47c-12464cebab69 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:17:03.129502 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e391e166-8dac-4fc0-a47c-12464cebab69 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:17:03.130314 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e391e166-8dac-4fc0-a47c-12464cebab69 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:17:03.130741 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-e391e166-8dac-4fc0-a47c-12464cebab69 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:17:03.298430 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-e391e166-8dac-4fc0-a47c-12464cebab69 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:17:03.306198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-e391e166-8dac-4fc0-a47c-12464cebab69 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.191646 May 16 19:17:03.306799 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 561/1163] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:17:03 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:17:04.324846 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f2e0cf2c-5271-45f6-965f-ec2d3d774bd0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:17:04.325565 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f2e0cf2c-5271-45f6-965f-ec2d3d774bd0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:17:04.332482 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f2e0cf2c-5271-45f6-965f-ec2d3d774bd0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:17:04.332924 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f2e0cf2c-5271-45f6-965f-ec2d3d774bd0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:17:04.333755 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f2e0cf2c-5271-45f6-965f-ec2d3d774bd0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:17:04.334179 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f2e0cf2c-5271-45f6-965f-ec2d3d774bd0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:17:04.467289 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f2e0cf2c-5271-45f6-965f-ec2d3d774bd0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:17:04.475122 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f2e0cf2c-5271-45f6-965f-ec2d3d774bd0 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1568 microversion: 2.1 time: 0.154622 May 16 19:17:04.475734 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 603/1164] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:17:04 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:17:05.190168 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-85cca131-8c5b-4552-8064-c2070c61dae7 req-b140e278-cce8-48e5-a3f8-3f861e822cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a385b0-58f3-4946-b6c6-2cbd20fe387f", "name": "network-vif-deleted", "tag": "aadd3356-5374-4e27-aec5-d1a129d4438b"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:17:05.199214 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-85cca131-8c5b-4552-8064-c2070c61dae7 req-b140e278-cce8-48e5-a3f8-3f861e822cd4 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:17:05.199704 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-85cca131-8c5b-4552-8064-c2070c61dae7 req-b140e278-cce8-48e5-a3f8-3f861e822cd4 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:17:05.211317 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-85cca131-8c5b-4552-8064-c2070c61dae7 req-b140e278-cce8-48e5-a3f8-3f861e822cd4 service nova] Creating event network-vif-deleted:aadd3356-5374-4e27-aec5-d1a129d4438b for instance 96a385b0-58f3-4946-b6c6-2cbd20fe387f on hv-cinder-76606 May 16 19:17:05.216357 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-85cca131-8c5b-4552-8064-c2070c61dae7 req-b140e278-cce8-48e5-a3f8-3f861e822cd4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029818 May 16 19:17:05.217068 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 562/1165] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:17:05.494753 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-3ff9312f-6b64-411a-9e26-54fff3fb7a98 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:17:05.495342 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-3ff9312f-6b64-411a-9e26-54fff3fb7a98 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:17:05.503091 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3ff9312f-6b64-411a-9e26-54fff3fb7a98 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:17:05.503967 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3ff9312f-6b64-411a-9e26-54fff3fb7a98 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:17:05.505045 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3ff9312f-6b64-411a-9e26-54fff3fb7a98 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:17:05.505713 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3ff9312f-6b64-411a-9e26-54fff3fb7a98 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:17:05.574693 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-3ff9312f-6b64-411a-9e26-54fff3fb7a98 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afce4f51384e37b381171cbc2e0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e758da8d71142bdbac8765efccefde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:17:05.586663 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-3ff9312f-6b64-411a-9e26-54fff3fb7a98 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 200 len: 1219 microversion: 2.1 time: 0.096678 May 16 19:17:05.587727 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 604/1166] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:17:05 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:17:06.605895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f6bc70c5-c10e-474c-82fe-252530570ed2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:17:06.606602 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-f6bc70c5-c10e-474c-82fe-252530570ed2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] [instance: 96a385b0-58f3-4946-b6c6-2cbd20fe387f] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:17:06.613222 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f6bc70c5-c10e-474c-82fe-252530570ed2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:17:06.613715 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f6bc70c5-c10e-474c-82fe-252530570ed2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:17:06.614485 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f6bc70c5-c10e-474c-82fe-252530570ed2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:17:06.614922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-f6bc70c5-c10e-474c-82fe-252530570ed2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:17:06.628564 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-f6bc70c5-c10e-474c-82fe-252530570ed2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] HTTP exception thrown: Instance 96a385b0-58f3-4946-b6c6-2cbd20fe387f could not be found. May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f6bc70c5-c10e-474c-82fe-252530570ed2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Request method failure captured: May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f HTTP/1.1 May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqGqYK1b7RoQLHMOJy3M-5vQxfdmqiJewfQEWvkLKAHabZJLq_JV0zjg9n1BKrN36TdoAEfOjPx6KcpLmu2TAYGQEdZBUaKla9wUONyW_A84sZWWYBeqYKCRTKxlSuHPUrv28NVfvFsoUzxiR8PNXJFjzDkDS2yzs9ftjyx6f0CWzfU May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: 5e758da8d71142bdbac8765efccefde8 May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-TestShelveInstance-1376280536 May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:17:06.630238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:17:06.631955 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5e758da8d71142bdbac8765efccefde8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5e758da8d71142bdbac8765efccefde8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5e758da8d71142bdbac8765efccefde8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5e758da8d71142bdbac8765efccefde8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:17:06.631955 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-TestShelveInstance-1376280536 May 16 19:17:06.631955 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: 5e758da8d71142bdbac8765efccefde8 May 16 19:17:06.631955 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-TestShelveInstance-1376280536 May 16 19:17:06.631955 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-TestShelveInstance-1376280536-project May 16 19:17:06.631955 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:17:06.631955 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:17:06.631955 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 16afce4f51384e37b381171cbc2e0a82 May 16 19:17:06.631955 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-TestShelveInstance-1376280536-project May 16 19:17:06.631955 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:17:06.631955 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance 96a385b0-58f3-4946-b6c6-2cbd20fe387f could not be found. May 16 19:17:06.631955 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': '96a385b0-58f3-4946-b6c6-2cbd20fe387f'} May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a385b0-58f3-4946-b6c6-2cbd20fe387f could not be found. May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:17:06.632987 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a385b0-58f3-4946-b6c6-2cbd20fe387f could not be found. May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a385b0-58f3-4946-b6c6-2cbd20fe387f could not be found. May 16 19:17:06.634577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:17:06.635960 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-f6bc70c5-c10e-474c-82fe-252530570ed2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Returning 404 to user: Instance 96a385b0-58f3-4946-b6c6-2cbd20fe387f could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:17:06.635960 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-f6bc70c5-c10e-474c-82fe-252530570ed2 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f" status: 404 len: 111 microversion: 2.1 time: 0.030751 May 16 19:17:06.635960 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 563/1167] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:17:06 2022] GET /compute/v2.1/servers/96a385b0-58f3-4946-b6c6-2cbd20fe387f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:17:06.807478 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-1a6e66aa-3cd0-44fc-ab53-16ed42dd1ce7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] Calling method '.version_select at 0x7f1e18ffad30>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:17:06.827521 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-1a6e66aa-3cd0-44fc-ab53-16ed42dd1ce7 tempest-TestShelveInstance-1376280536 tempest-TestShelveInstance-1376280536-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1526048130" status: 202 len: 0 microversion: 2.1 time: 0.023980 May 16 19:17:06.828105 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 605/1168] 10.222.0.24 () {58 vars in 1253 bytes} [Mon May 16 19:17:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1526048130 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:18:10.466451 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:18:10.467421 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Mon May 16 19:18:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:18:40.584933 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-74ede0f7-13b9-43f5-92dc-17fbb6771f68 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1941367858", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1176123874", "security_groups": [{"name": "tempest-secgroup-smoke-33929672"}], "block_device_mapping_v2": [{"uuid": "5102213a-594d-41b8-a3a9-2badb49b1606", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "76a0db38-1a09-4cf8-86ec-0bf0b9de76ec"}]}} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:18:40.869310 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.network.neutron [None req-74ede0f7-13b9-43f5-92dc-17fbb6771f68 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] validate_networks() for [('76a0db38-1a09-4cf8-86ec-0bf0b9de76ec', None, None, None, None, None)] {{(pid=117275) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 19:18:41.259911 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-74ede0f7-13b9-43f5-92dc-17fbb6771f68 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Flavor limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 19:18:41.260337 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-74ede0f7-13b9-43f5-92dc-17fbb6771f68 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Image limits 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 19:18:41.260785 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-74ede0f7-13b9-43f5-92dc-17fbb6771f68 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Flavor pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 19:18:41.261198 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-74ede0f7-13b9-43f5-92dc-17fbb6771f68 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Image pref 0:0:0 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 19:18:41.261646 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.virt.hardware [None req-74ede0f7-13b9-43f5-92dc-17fbb6771f68 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 19:18:41.271608 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-74ede0f7-13b9-43f5-92dc-17fbb6771f68 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:41.272057 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-74ede0f7-13b9-43f5-92dc-17fbb6771f68 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:41.272904 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-74ede0f7-13b9-43f5-92dc-17fbb6771f68 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:41.273337 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-74ede0f7-13b9-43f5-92dc-17fbb6771f68 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:41.290759 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-74ede0f7-13b9-43f5-92dc-17fbb6771f68 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Getting quotas for project 385ae3c7ea8347d7bfc346d8bc7fda4a. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 19:18:41.295174 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.quota [None req-74ede0f7-13b9-43f5-92dc-17fbb6771f68 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Getting quotas for user 64634c902a884b84a8bd2d3c10ce6270 and project 385ae3c7ea8347d7bfc346d8bc7fda4a. Resources: {'cores', 'instances', 'ram'} {{(pid=117275) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 19:18:41.402935 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-74ede0f7-13b9-43f5-92dc-17fbb6771f68 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Going to run 1 instances... {{(pid=117275) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 19:18:41.405182 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-74ede0f7-13b9-43f5-92dc-17fbb6771f68 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5102213a-594d-41b8-a3a9-2badb49b1606',volume_size=None,volume_type=None)] {{(pid=117275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 19:18:41.531528 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-74ede0f7-13b9-43f5-92dc-17fbb6771f68 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.954987 May 16 19:18:41.532088 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 564/1169] 10.222.0.24 () {60 vars in 1146 bytes} [Mon May 16 19:18:40 2022] POST /compute/v2.1/servers => generated 404 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 19:18:41.543842 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-d1741814-24a9-4f88-ab36-afca229cda09 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:18:41.544460 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-d1741814-24a9-4f88-ab36-afca229cda09 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:18:41.704488 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-d1741814-24a9-4f88-ab36-afca229cda09 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:18:41.712634 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-d1741814-24a9-4f88-ab36-afca229cda09 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1095 microversion: 2.1 time: 0.173955 May 16 19:18:41.713192 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 606/1170] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:18:41 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1095 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:18:42.730348 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-cabaedb9-94f1-49f5-9871-bb89aed67d85 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:18:42.730967 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-cabaedb9-94f1-49f5-9871-bb89aed67d85 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:18:42.737283 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cabaedb9-94f1-49f5-9871-bb89aed67d85 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:42.737811 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cabaedb9-94f1-49f5-9871-bb89aed67d85 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:42.738585 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cabaedb9-94f1-49f5-9871-bb89aed67d85 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:42.739044 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cabaedb9-94f1-49f5-9871-bb89aed67d85 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:42.806854 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-cabaedb9-94f1-49f5-9871-bb89aed67d85 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:18:42.814395 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-cabaedb9-94f1-49f5-9871-bb89aed67d85 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1211 microversion: 2.1 time: 0.088704 May 16 19:18:42.814996 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 565/1171] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:18:42 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:18:43.832155 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e581a74a-e30e-4708-90a6-50ed2c6848c5 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:18:43.832733 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-e581a74a-e30e-4708-90a6-50ed2c6848c5 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:18:43.839841 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e581a74a-e30e-4708-90a6-50ed2c6848c5 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:43.841267 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e581a74a-e30e-4708-90a6-50ed2c6848c5 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:43.842273 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e581a74a-e30e-4708-90a6-50ed2c6848c5 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:43.842858 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-e581a74a-e30e-4708-90a6-50ed2c6848c5 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:43.994657 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-e581a74a-e30e-4708-90a6-50ed2c6848c5 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:18:44.006259 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e581a74a-e30e-4708-90a6-50ed2c6848c5 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1265 microversion: 2.1 time: 0.176109 May 16 19:18:44.018201 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 607/1172] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:18:43 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:18:44.080803 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-06efdbc0-c633-4734-ab34-bcee7357a2f1 req-3fd1c972-79de-4430-8d54-45e1a5033f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6455f3f6-ed55-4047-b88c-54163356d9f5", "tag": "ab3a9707-dcd0-4d4c-bcba-ec7c465fe405"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:18:44.089181 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-06efdbc0-c633-4734-ab34-bcee7357a2f1 req-3fd1c972-79de-4430-8d54-45e1a5033f88 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:44.089628 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-06efdbc0-c633-4734-ab34-bcee7357a2f1 req-3fd1c972-79de-4430-8d54-45e1a5033f88 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:44.101086 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-06efdbc0-c633-4734-ab34-bcee7357a2f1 req-3fd1c972-79de-4430-8d54-45e1a5033f88 service nova] Creating event network-changed:ab3a9707-dcd0-4d4c-bcba-ec7c465fe405 for instance 6455f3f6-ed55-4047-b88c-54163356d9f5 on hv-cinder-76606 May 16 19:18:44.106588 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-06efdbc0-c633-4734-ab34-bcee7357a2f1 req-3fd1c972-79de-4430-8d54-45e1a5033f88 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097036 May 16 19:18:44.107556 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 566/1173] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:18:45.025167 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-52faec45-171a-4732-bd63-9306936293e6 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:18:45.025882 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-52faec45-171a-4732-bd63-9306936293e6 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:18:45.033368 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-52faec45-171a-4732-bd63-9306936293e6 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:45.033886 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-52faec45-171a-4732-bd63-9306936293e6 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:45.034664 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-52faec45-171a-4732-bd63-9306936293e6 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:45.035228 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-52faec45-171a-4732-bd63-9306936293e6 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:45.177365 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-52faec45-171a-4732-bd63-9306936293e6 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:18:45.185033 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-52faec45-171a-4732-bd63-9306936293e6 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1265 microversion: 2.1 time: 0.163988 May 16 19:18:45.185951 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 608/1174] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:18:45 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:18:46.203979 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-2b6df5b7-8f52-4d36-a975-00f66410a00b tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:18:46.204708 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-2b6df5b7-8f52-4d36-a975-00f66410a00b tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:18:46.211517 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2b6df5b7-8f52-4d36-a975-00f66410a00b tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:46.211991 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2b6df5b7-8f52-4d36-a975-00f66410a00b tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:46.212791 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2b6df5b7-8f52-4d36-a975-00f66410a00b tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:46.213240 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-2b6df5b7-8f52-4d36-a975-00f66410a00b tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:46.346171 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-2b6df5b7-8f52-4d36-a975-00f66410a00b tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:18:46.353682 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-2b6df5b7-8f52-4d36-a975-00f66410a00b tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1265 microversion: 2.1 time: 0.154696 May 16 19:18:46.354252 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 567/1175] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:18:46 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:18:47.373584 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ecfb96b1-22f5-4a35-898f-6222f00fc076 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:18:47.374536 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ecfb96b1-22f5-4a35-898f-6222f00fc076 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:18:47.384007 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ecfb96b1-22f5-4a35-898f-6222f00fc076 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:47.384693 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ecfb96b1-22f5-4a35-898f-6222f00fc076 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:47.385841 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ecfb96b1-22f5-4a35-898f-6222f00fc076 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:47.386460 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ecfb96b1-22f5-4a35-898f-6222f00fc076 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:47.526571 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ecfb96b1-22f5-4a35-898f-6222f00fc076 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:18:47.536745 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ecfb96b1-22f5-4a35-898f-6222f00fc076 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1265 microversion: 2.1 time: 0.168945 May 16 19:18:47.537308 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 609/1176] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:18:47 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:18:48.558683 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-eb81ebeb-fb4b-426f-a05d-0a9094939727 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:18:48.559568 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-eb81ebeb-fb4b-426f-a05d-0a9094939727 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:18:48.568856 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eb81ebeb-fb4b-426f-a05d-0a9094939727 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:48.569304 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eb81ebeb-fb4b-426f-a05d-0a9094939727 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:48.570106 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eb81ebeb-fb4b-426f-a05d-0a9094939727 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:48.570543 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-eb81ebeb-fb4b-426f-a05d-0a9094939727 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:48.713238 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-eb81ebeb-fb4b-426f-a05d-0a9094939727 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:18:48.725209 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-eb81ebeb-fb4b-426f-a05d-0a9094939727 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1265 microversion: 2.1 time: 0.173147 May 16 19:18:48.726033 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 568/1177] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:18:48 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:18:49.751517 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ad010298-8974-406e-a135-314257dadb7d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:18:49.752250 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ad010298-8974-406e-a135-314257dadb7d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:18:49.759578 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ad010298-8974-406e-a135-314257dadb7d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:49.760028 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ad010298-8974-406e-a135-314257dadb7d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:49.760800 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ad010298-8974-406e-a135-314257dadb7d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:49.761236 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ad010298-8974-406e-a135-314257dadb7d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:49.898494 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ad010298-8974-406e-a135-314257dadb7d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:18:49.905996 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ad010298-8974-406e-a135-314257dadb7d tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1265 microversion: 2.1 time: 0.161048 May 16 19:18:49.906563 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 610/1178] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:18:49 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:18:50.927761 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-ae3cd395-6009-4471-baa6-1cd5da3c965e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:18:50.928808 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-ae3cd395-6009-4471-baa6-1cd5da3c965e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:18:50.939531 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ae3cd395-6009-4471-baa6-1cd5da3c965e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:50.940291 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ae3cd395-6009-4471-baa6-1cd5da3c965e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:50.941455 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ae3cd395-6009-4471-baa6-1cd5da3c965e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:50.941917 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-ae3cd395-6009-4471-baa6-1cd5da3c965e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:51.084374 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-ae3cd395-6009-4471-baa6-1cd5da3c965e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:18:51.096292 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-ae3cd395-6009-4471-baa6-1cd5da3c965e tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1265 microversion: 2.1 time: 0.174911 May 16 19:18:51.097180 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 569/1179] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:18:50 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:18:52.117590 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-fb87879c-cc76-443b-ad09-50e471e0e0d7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:18:52.118477 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-fb87879c-cc76-443b-ad09-50e471e0e0d7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:18:52.128806 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb87879c-cc76-443b-ad09-50e471e0e0d7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:52.129571 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb87879c-cc76-443b-ad09-50e471e0e0d7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:52.130830 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb87879c-cc76-443b-ad09-50e471e0e0d7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:52.131540 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-fb87879c-cc76-443b-ad09-50e471e0e0d7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:52.276349 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-fb87879c-cc76-443b-ad09-50e471e0e0d7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:18:52.288164 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-fb87879c-cc76-443b-ad09-50e471e0e0d7 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1265 microversion: 2.1 time: 0.177437 May 16 19:18:52.289062 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 611/1180] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:18:52 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:18:53.310020 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-840c62f0-5152-43df-8338-ea358c5c4ebb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:18:53.310629 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-840c62f0-5152-43df-8338-ea358c5c4ebb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:18:53.316885 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-840c62f0-5152-43df-8338-ea358c5c4ebb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:53.317327 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-840c62f0-5152-43df-8338-ea358c5c4ebb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:53.318119 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-840c62f0-5152-43df-8338-ea358c5c4ebb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:53.318549 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-840c62f0-5152-43df-8338-ea358c5c4ebb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:53.453902 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-840c62f0-5152-43df-8338-ea358c5c4ebb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:18:53.469592 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-840c62f0-5152-43df-8338-ea358c5c4ebb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1265 microversion: 2.1 time: 0.163231 May 16 19:18:53.470382 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 570/1181] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:18:53 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:18:54.491904 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-dce4d09d-2de8-4614-8419-2f791e74c6ea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:18:54.492467 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-dce4d09d-2de8-4614-8419-2f791e74c6ea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:18:54.499612 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dce4d09d-2de8-4614-8419-2f791e74c6ea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:54.500064 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dce4d09d-2de8-4614-8419-2f791e74c6ea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:54.500812 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dce4d09d-2de8-4614-8419-2f791e74c6ea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:54.501278 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-dce4d09d-2de8-4614-8419-2f791e74c6ea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:54.644653 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-dce4d09d-2de8-4614-8419-2f791e74c6ea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:18:54.652831 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-dce4d09d-2de8-4614-8419-2f791e74c6ea tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1265 microversion: 2.1 time: 0.165646 May 16 19:18:54.653413 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 612/1182] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:18:54 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:18:55.329037 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-cd588b17-aae6-456b-b5dc-edc6b1c681bb req-3cc6c364-fcfd-4df3-a253-e93b5b1f2abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6455f3f6-ed55-4047-b88c-54163356d9f5", "name": "network-vif-plugged", "status": "completed", "tag": "ab3a9707-dcd0-4d4c-bcba-ec7c465fe405"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:18:55.337965 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-cd588b17-aae6-456b-b5dc-edc6b1c681bb req-3cc6c364-fcfd-4df3-a253-e93b5b1f2abd service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:55.338449 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-cd588b17-aae6-456b-b5dc-edc6b1c681bb req-3cc6c364-fcfd-4df3-a253-e93b5b1f2abd service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:55.350608 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-cd588b17-aae6-456b-b5dc-edc6b1c681bb req-3cc6c364-fcfd-4df3-a253-e93b5b1f2abd service nova] Creating event network-vif-plugged:ab3a9707-dcd0-4d4c-bcba-ec7c465fe405 for instance 6455f3f6-ed55-4047-b88c-54163356d9f5 on hv-cinder-76606 May 16 19:18:55.355797 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-cd588b17-aae6-456b-b5dc-edc6b1c681bb req-3cc6c364-fcfd-4df3-a253-e93b5b1f2abd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030514 May 16 19:18:55.356419 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 571/1183] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:18:55.672228 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-8defbaeb-b0f1-48e9-92e3-b4fec7ef8291 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:18:55.672846 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-8defbaeb-b0f1-48e9-92e3-b4fec7ef8291 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:18:55.679791 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8defbaeb-b0f1-48e9-92e3-b4fec7ef8291 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:55.680251 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8defbaeb-b0f1-48e9-92e3-b4fec7ef8291 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:55.681025 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8defbaeb-b0f1-48e9-92e3-b4fec7ef8291 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:55.681422 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-8defbaeb-b0f1-48e9-92e3-b4fec7ef8291 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:55.816438 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-8defbaeb-b0f1-48e9-92e3-b4fec7ef8291 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:18:55.824203 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-8defbaeb-b0f1-48e9-92e3-b4fec7ef8291 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1265 microversion: 2.1 time: 0.155880 May 16 19:18:55.824710 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 613/1184] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:18:55 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:18:56.845984 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-a8440184-f976-4b9d-ba56-bee21d054d08 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:18:56.847116 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-a8440184-f976-4b9d-ba56-bee21d054d08 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:18:56.854734 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a8440184-f976-4b9d-ba56-bee21d054d08 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:56.855189 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a8440184-f976-4b9d-ba56-bee21d054d08 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:56.855963 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a8440184-f976-4b9d-ba56-bee21d054d08 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:56.856403 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-a8440184-f976-4b9d-ba56-bee21d054d08 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:56.989787 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-a8440184-f976-4b9d-ba56-bee21d054d08 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:18:56.997467 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-a8440184-f976-4b9d-ba56-bee21d054d08 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1452 microversion: 2.1 time: 0.158667 May 16 19:18:56.998125 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 572/1185] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:18:56 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:18:57.013389 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-a8291b22-945d-493b-820c-7ad1861efbec tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:18:57.014049 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-a8291b22-945d-493b-820c-7ad1861efbec tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:18:57.021647 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a8291b22-945d-493b-820c-7ad1861efbec tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:57.022104 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a8291b22-945d-493b-820c-7ad1861efbec tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:57.022881 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a8291b22-945d-493b-820c-7ad1861efbec tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:57.023317 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-a8291b22-945d-493b-820c-7ad1861efbec tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:57.167126 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-a8291b22-945d-493b-820c-7ad1861efbec tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:18:57.175171 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-a8291b22-945d-493b-820c-7ad1861efbec tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1452 microversion: 2.1 time: 0.165659 May 16 19:18:57.175747 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 614/1186] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:18:57 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:18:59.119739 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-02f91406-4b6a-473b-803c-433ad20c50a1 req-33900078-7a12-46c4-9df0-cd8db6a52a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6455f3f6-ed55-4047-b88c-54163356d9f5", "tag": "ab3a9707-dcd0-4d4c-bcba-ec7c465fe405"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:18:59.128130 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-02f91406-4b6a-473b-803c-433ad20c50a1 req-33900078-7a12-46c4-9df0-cd8db6a52a03 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:18:59.128577 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-02f91406-4b6a-473b-803c-433ad20c50a1 req-33900078-7a12-46c4-9df0-cd8db6a52a03 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:18:59.142386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-02f91406-4b6a-473b-803c-433ad20c50a1 req-33900078-7a12-46c4-9df0-cd8db6a52a03 service nova] Creating event network-changed:ab3a9707-dcd0-4d4c-bcba-ec7c465fe405 for instance 6455f3f6-ed55-4047-b88c-54163356d9f5 on hv-cinder-76606 May 16 19:18:59.147500 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-02f91406-4b6a-473b-803c-433ad20c50a1 req-33900078-7a12-46c4-9df0-cd8db6a52a03 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089535 May 16 19:18:59.148093 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 573/1187] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:19:49.452501 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:19:49.453425 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Mon May 16 19:19:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:20:16.179084 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:20:16.179771 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Mon May 16 19:20:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:20:18.002259 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:20:18.003318 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Mon May 16 19:20:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:20:38.777273 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-bc103b0e-26e8-4480-9b24-5ca6812f37a8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:20:38.778041 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-bc103b0e-26e8-4480-9b24-5ca6812f37a8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:20:38.780115 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-f0a605e2-1e5e-46eb-acf0-ce0bb291333b req-00b50221-ea63-4196-91a2-75afedeb1b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6455f3f6-ed55-4047-b88c-54163356d9f5", "tag": "ab3a9707-dcd0-4d4c-bcba-ec7c465fe405"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:20:38.784970 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bc103b0e-26e8-4480-9b24-5ca6812f37a8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:38.785423 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bc103b0e-26e8-4480-9b24-5ca6812f37a8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:38.786240 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bc103b0e-26e8-4480-9b24-5ca6812f37a8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:38.786629 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-bc103b0e-26e8-4480-9b24-5ca6812f37a8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:38.788846 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-f0a605e2-1e5e-46eb-acf0-ce0bb291333b req-00b50221-ea63-4196-91a2-75afedeb1b59 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:38.789256 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-f0a605e2-1e5e-46eb-acf0-ce0bb291333b req-00b50221-ea63-4196-91a2-75afedeb1b59 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:38.800942 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-f0a605e2-1e5e-46eb-acf0-ce0bb291333b req-00b50221-ea63-4196-91a2-75afedeb1b59 service nova] Creating event network-changed:ab3a9707-dcd0-4d4c-bcba-ec7c465fe405 for instance 6455f3f6-ed55-4047-b88c-54163356d9f5 on hv-cinder-76606 May 16 19:20:38.806995 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-f0a605e2-1e5e-46eb-acf0-ce0bb291333b req-00b50221-ea63-4196-91a2-75afedeb1b59 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038370 May 16 19:20:38.807589 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 574/1188] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:20:38.815964 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-bc103b0e-26e8-4480-9b24-5ca6812f37a8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Going to try to terminate instance {{(pid=117274) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:20:38.900736 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-bc103b0e-26e8-4480-9b24-5ca6812f37a8 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "DELETE /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 204 len: 0 microversion: 2.1 time: 0.134881 May 16 19:20:38.901343 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 615/1189] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:20:38 2022] DELETE /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 19:20:38.910687 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-23b53717-8a40-4978-bc0b-19d49c2f5f04 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:20:38.911701 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-23b53717-8a40-4978-bc0b-19d49c2f5f04 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:20:38.918222 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-23b53717-8a40-4978-bc0b-19d49c2f5f04 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:38.918668 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-23b53717-8a40-4978-bc0b-19d49c2f5f04 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:38.919448 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-23b53717-8a40-4978-bc0b-19d49c2f5f04 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:38.919899 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-23b53717-8a40-4978-bc0b-19d49c2f5f04 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:39.073523 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-23b53717-8a40-4978-bc0b-19d49c2f5f04 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:20:39.081790 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-23b53717-8a40-4978-bc0b-19d49c2f5f04 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1577 microversion: 2.1 time: 0.175734 May 16 19:20:39.082375 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 575/1190] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:20:38 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:20:40.099863 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-f14d0a18-8f76-4b8b-9073-d8b4414e69db tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:20:40.100554 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-f14d0a18-8f76-4b8b-9073-d8b4414e69db tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:20:40.107590 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f14d0a18-8f76-4b8b-9073-d8b4414e69db tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:40.108037 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f14d0a18-8f76-4b8b-9073-d8b4414e69db tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:40.108858 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f14d0a18-8f76-4b8b-9073-d8b4414e69db tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:40.109345 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-f14d0a18-8f76-4b8b-9073-d8b4414e69db tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:40.247703 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-f14d0a18-8f76-4b8b-9073-d8b4414e69db tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:20:40.255806 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-f14d0a18-8f76-4b8b-9073-d8b4414e69db tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1577 microversion: 2.1 time: 0.160335 May 16 19:20:40.256400 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 616/1191] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:20:40 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:20:41.212437 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-427c377c-2e1e-4009-8333-46cd3d028ebd req-7114076a-02e4-40c9-b6ee-2302ce384af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6455f3f6-ed55-4047-b88c-54163356d9f5", "name": "network-vif-deleted", "tag": "ab3a9707-dcd0-4d4c-bcba-ec7c465fe405"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:20:41.222930 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-427c377c-2e1e-4009-8333-46cd3d028ebd req-7114076a-02e4-40c9-b6ee-2302ce384af0 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:41.223483 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-427c377c-2e1e-4009-8333-46cd3d028ebd req-7114076a-02e4-40c9-b6ee-2302ce384af0 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:41.235557 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-427c377c-2e1e-4009-8333-46cd3d028ebd req-7114076a-02e4-40c9-b6ee-2302ce384af0 service nova] Creating event network-vif-deleted:ab3a9707-dcd0-4d4c-bcba-ec7c465fe405 for instance 6455f3f6-ed55-4047-b88c-54163356d9f5 on hv-cinder-76606 May 16 19:20:41.241239 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-427c377c-2e1e-4009-8333-46cd3d028ebd req-7114076a-02e4-40c9-b6ee-2302ce384af0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032580 May 16 19:20:41.242166 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 576/1192] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:20:41.272507 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-9c4fa402-f1f6-49fc-a84c-4d02cbfae7eb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:20:41.273111 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-9c4fa402-f1f6-49fc-a84c-4d02cbfae7eb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:20:41.279610 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9c4fa402-f1f6-49fc-a84c-4d02cbfae7eb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:41.280059 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9c4fa402-f1f6-49fc-a84c-4d02cbfae7eb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:41.280833 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9c4fa402-f1f6-49fc-a84c-4d02cbfae7eb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:41.281336 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-9c4fa402-f1f6-49fc-a84c-4d02cbfae7eb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:41.341795 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-9c4fa402-f1f6-49fc-a84c-4d02cbfae7eb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:20:41.349447 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-9c4fa402-f1f6-49fc-a84c-4d02cbfae7eb tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 200 len: 1226 microversion: 2.1 time: 0.081162 May 16 19:20:41.350049 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 617/1193] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:20:41 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:20:42.372220 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-348ee6b4-fbfa-435d-b81e-9dddeacd0cf4 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:20:42.373393 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-348ee6b4-fbfa-435d-b81e-9dddeacd0cf4 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 6455f3f6-ed55-4047-b88c-54163356d9f5] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:20:42.384084 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-348ee6b4-fbfa-435d-b81e-9dddeacd0cf4 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:42.384835 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-348ee6b4-fbfa-435d-b81e-9dddeacd0cf4 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:42.386199 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-348ee6b4-fbfa-435d-b81e-9dddeacd0cf4 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:42.386886 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-348ee6b4-fbfa-435d-b81e-9dddeacd0cf4 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:42.403405 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-348ee6b4-fbfa-435d-b81e-9dddeacd0cf4 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] HTTP exception thrown: Instance 6455f3f6-ed55-4047-b88c-54163356d9f5 could not be found. May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-348ee6b4-fbfa-435d-b81e-9dddeacd0cf4 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Request method failure captured: May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 HTTP/1.1 May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqJf3RbHQYJhmEptKp0cS0QguIxgNpF161dv1ZMYhO7NnbLclJBZ8JyvVydLvuEe0Bt0rjKelXzGJkrgFrx-L6AK9uLlS4H6jbcsmD5GSJP7ikjeTqYhpbhwhn1ujqcJC65gj-9zdrNvI0_fQlah583iAhEi71CSp_RyTQ5llGG6lys May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: 385ae3c7ea8347d7bfc346d8bc7fda4a May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-TestVolumeBootPattern-1099673589 May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:20:42.405039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:20:42.406784 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:20:42.406784 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-TestVolumeBootPattern-1099673589 May 16 19:20:42.406784 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: 385ae3c7ea8347d7bfc346d8bc7fda4a May 16 19:20:42.406784 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-TestVolumeBootPattern-1099673589 May 16 19:20:42.406784 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-TestVolumeBootPattern-1099673589-project May 16 19:20:42.406784 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:20:42.406784 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:20:42.406784 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 64634c902a884b84a8bd2d3c10ce6270 May 16 19:20:42.406784 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-TestVolumeBootPattern-1099673589-project May 16 19:20:42.406784 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:20:42.406784 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance 6455f3f6-ed55-4047-b88c-54163356d9f5 could not be found. May 16 19:20:42.406784 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': '6455f3f6-ed55-4047-b88c-54163356d9f5'} May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6455f3f6-ed55-4047-b88c-54163356d9f5 could not be found. May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:20:42.407910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6455f3f6-ed55-4047-b88c-54163356d9f5 could not be found. May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6455f3f6-ed55-4047-b88c-54163356d9f5 could not be found. May 16 19:20:42.409462 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:20:42.411039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-348ee6b4-fbfa-435d-b81e-9dddeacd0cf4 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Returning 404 to user: Instance 6455f3f6-ed55-4047-b88c-54163356d9f5 could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:20:42.411039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-348ee6b4-fbfa-435d-b81e-9dddeacd0cf4 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5" status: 404 len: 111 microversion: 2.1 time: 0.042218 May 16 19:20:42.411039 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 577/1194] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:20:42 2022] GET /compute/v2.1/servers/6455f3f6-ed55-4047-b88c-54163356d9f5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:20:45.508869 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-3972f6fa-b5a9-4f8a-a8a6-0514d3762a42 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:20:45.509421 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-3972f6fa-b5a9-4f8a-a8a6-0514d3762a42 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:20:45.511066 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-aaa16f7b-950e-445d-a338-723e0130bbe1 req-ce25acc3-f08c-4a59-a068-90bc0f3fe7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55dfa22e-8502-4ec3-908d-a2315cd2c23d", "tag": "5ae7f641-8210-4168-952a-e6c7ee9608d0"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:20:45.516375 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3972f6fa-b5a9-4f8a-a8a6-0514d3762a42 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:45.516834 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3972f6fa-b5a9-4f8a-a8a6-0514d3762a42 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:45.517926 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3972f6fa-b5a9-4f8a-a8a6-0514d3762a42 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:45.518443 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-3972f6fa-b5a9-4f8a-a8a6-0514d3762a42 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:45.521738 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-aaa16f7b-950e-445d-a338-723e0130bbe1 req-ce25acc3-f08c-4a59-a068-90bc0f3fe7b4 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:45.522193 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-aaa16f7b-950e-445d-a338-723e0130bbe1 req-ce25acc3-f08c-4a59-a068-90bc0f3fe7b4 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:45.534491 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-aaa16f7b-950e-445d-a338-723e0130bbe1 req-ce25acc3-f08c-4a59-a068-90bc0f3fe7b4 service nova] Creating event network-changed:5ae7f641-8210-4168-952a-e6c7ee9608d0 for instance 55dfa22e-8502-4ec3-908d-a2315cd2c23d on hv-cinder-76606 May 16 19:20:45.540286 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-aaa16f7b-950e-445d-a338-723e0130bbe1 req-ce25acc3-f08c-4a59-a068-90bc0f3fe7b4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032935 May 16 19:20:45.541342 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 578/1195] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 19:20:45.553987 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-3972f6fa-b5a9-4f8a-a8a6-0514d3762a42 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Going to try to terminate instance {{(pid=117274) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 19:20:45.648277 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-3972f6fa-b5a9-4f8a-a8a6-0514d3762a42 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "DELETE /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 204 len: 0 microversion: 2.1 time: 0.143088 May 16 19:20:45.648879 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 618/1196] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:20:45 2022] DELETE /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 19:20:45.662832 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-b81512a1-b533-4594-8662-167cb0eff796 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:20:45.663936 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-b81512a1-b533-4594-8662-167cb0eff796 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:20:45.671757 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b81512a1-b533-4594-8662-167cb0eff796 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:45.672255 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b81512a1-b533-4594-8662-167cb0eff796 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:45.673113 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b81512a1-b533-4594-8662-167cb0eff796 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:45.673635 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-b81512a1-b533-4594-8662-167cb0eff796 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:45.815568 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.policy [None req-b81512a1-b533-4594-8662-167cb0eff796 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117275) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:20:45.823922 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-b81512a1-b533-4594-8662-167cb0eff796 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1576 microversion: 2.1 time: 0.167745 May 16 19:20:45.824498 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 579/1197] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:20:45 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:20:46.842431 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-ced23512-54bd-4645-bacb-87b96755034a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:20:46.843031 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-ced23512-54bd-4645-bacb-87b96755034a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:20:46.849682 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ced23512-54bd-4645-bacb-87b96755034a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:46.850122 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ced23512-54bd-4645-bacb-87b96755034a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:46.850881 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ced23512-54bd-4645-bacb-87b96755034a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:46.851300 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-ced23512-54bd-4645-bacb-87b96755034a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:47.002625 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-ced23512-54bd-4645-bacb-87b96755034a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:20:47.011273 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-ced23512-54bd-4645-bacb-87b96755034a tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1576 microversion: 2.1 time: 0.173502 May 16 19:20:47.011850 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 619/1198] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:20:46 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:20:47.563543 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [req-270e4549-8ac3-4d08-ae85-814848724f21 req-c1dfec81-73e4-4f26-b96c-56fd82be4656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55dfa22e-8502-4ec3-908d-a2315cd2c23d", "name": "network-vif-deleted", "tag": "5ae7f641-8210-4168-952a-e6c7ee9608d0"}]} {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 19:20:47.572401 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-270e4549-8ac3-4d08-ae85-814848724f21 req-c1dfec81-73e4-4f26-b96c-56fd82be4656 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:47.572840 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [req-270e4549-8ac3-4d08-ae85-814848724f21 req-c1dfec81-73e4-4f26-b96c-56fd82be4656 service nova] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:47.584386 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.compute.server_external_events [req-270e4549-8ac3-4d08-ae85-814848724f21 req-c1dfec81-73e4-4f26-b96c-56fd82be4656 service nova] Creating event network-vif-deleted:5ae7f641-8210-4168-952a-e6c7ee9608d0 for instance 55dfa22e-8502-4ec3-908d-a2315cd2c23d on hv-cinder-76606 May 16 19:20:47.589430 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [req-270e4549-8ac3-4d08-ae85-814848724f21 req-c1dfec81-73e4-4f26-b96c-56fd82be4656 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029607 May 16 19:20:47.590567 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 580/1199] 10.222.0.24 () {64 vars in 1317 bytes} [Mon May 16 19:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 19:20:48.028454 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-7087060b-2b51-4b3d-bd48-a65625cd2d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:20:48.028973 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-7087060b-2b51-4b3d-bd48-a65625cd2d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:20:48.035789 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7087060b-2b51-4b3d-bd48-a65625cd2d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:48.036241 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7087060b-2b51-4b3d-bd48-a65625cd2d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:48.037014 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7087060b-2b51-4b3d-bd48-a65625cd2d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:48.037446 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7087060b-2b51-4b3d-bd48-a65625cd2d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:48.068775 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7087060b-2b51-4b3d-bd48-a65625cd2d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:48.069221 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-7087060b-2b51-4b3d-bd48-a65625cd2d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:48.069718 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.objects.instance [None req-7087060b-2b51-4b3d-bd48-a65625cd2d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lazy-loading 'fault' on Instance uuid 55dfa22e-8502-4ec3-908d-a2315cd2c23d {{(pid=117274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 19:20:48.111136 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.policy [None req-7087060b-2b51-4b3d-bd48-a65625cd2d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64634c902a884b84a8bd2d3c10ce6270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117274) authorize /opt/stack/nova/nova/policy.py:199}} May 16 19:20:48.120043 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-7087060b-2b51-4b3d-bd48-a65625cd2d9c tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 200 len: 1230 microversion: 2.1 time: 0.094429 May 16 19:20:48.121482 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 620/1200] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:20:48 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 19:20:49.143441 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-cdff80ae-bbec-491b-965a-eb1433e6ab88 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:20:49.144165 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-cdff80ae-bbec-491b-965a-eb1433e6ab88 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 55dfa22e-8502-4ec3-908d-a2315cd2c23d] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:20:49.151280 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cdff80ae-bbec-491b-965a-eb1433e6ab88 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:49.151721 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cdff80ae-bbec-491b-965a-eb1433e6ab88 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:49.152482 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cdff80ae-bbec-491b-965a-eb1433e6ab88 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:49.152910 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-cdff80ae-bbec-491b-965a-eb1433e6ab88 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:49.166568 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-cdff80ae-bbec-491b-965a-eb1433e6ab88 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] HTTP exception thrown: Instance 55dfa22e-8502-4ec3-908d-a2315cd2c23d could not be found. May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-cdff80ae-bbec-491b-965a-eb1433e6ab88 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Request method failure captured: May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d HTTP/1.1 May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqJf3RbHQYJhmEptKp0cS0QguIxgNpF161dv1ZMYhO7NnbLclJBZ8JyvVydLvuEe0Bt0rjKelXzGJkrgFrx-L6AK9uLlS4H6jbcsmD5GSJP7ikjeTqYhpbhwhn1ujqcJC65gj-9zdrNvI0_fQlah583iAhEi71CSp_RyTQ5llGG6lys May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: 385ae3c7ea8347d7bfc346d8bc7fda4a May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-TestVolumeBootPattern-1099673589 May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:20:49.168190 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:20:49.169841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:20:49.169841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-TestVolumeBootPattern-1099673589 May 16 19:20:49.169841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: 385ae3c7ea8347d7bfc346d8bc7fda4a May 16 19:20:49.169841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-TestVolumeBootPattern-1099673589 May 16 19:20:49.169841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-TestVolumeBootPattern-1099673589-project May 16 19:20:49.169841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:20:49.169841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:20:49.169841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 64634c902a884b84a8bd2d3c10ce6270 May 16 19:20:49.169841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-TestVolumeBootPattern-1099673589-project May 16 19:20:49.169841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:20:49.169841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance 55dfa22e-8502-4ec3-908d-a2315cd2c23d could not be found. May 16 19:20:49.169841 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': '55dfa22e-8502-4ec3-908d-a2315cd2c23d'} May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55dfa22e-8502-4ec3-908d-a2315cd2c23d could not be found. May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:20:49.170770 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55dfa22e-8502-4ec3-908d-a2315cd2c23d could not be found. May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55dfa22e-8502-4ec3-908d-a2315cd2c23d could not be found. May 16 19:20:49.172316 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:20:49.173951 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-cdff80ae-bbec-491b-965a-eb1433e6ab88 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Returning 404 to user: Instance 55dfa22e-8502-4ec3-908d-a2315cd2c23d could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:20:49.173951 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-cdff80ae-bbec-491b-965a-eb1433e6ab88 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d" status: 404 len: 111 microversion: 2.1 time: 0.033765 May 16 19:20:49.173951 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 581/1201] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:20:49 2022] GET /compute/v2.1/servers/55dfa22e-8502-4ec3-908d-a2315cd2c23d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:20:49.617840 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-598fe763-25be-431e-9e06-c62a926fa1da tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:20:49.618388 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.compute.api [None req-598fe763-25be-431e-9e06-c62a926fa1da tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117274) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:20:49.624737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-598fe763-25be-431e-9e06-c62a926fa1da tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:49.625186 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-598fe763-25be-431e-9e06-c62a926fa1da tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:49.625993 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-598fe763-25be-431e-9e06-c62a926fa1da tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:49.626420 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG oslo_concurrency.lockutils [None req-598fe763-25be-431e-9e06-c62a926fa1da tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:49.640680 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.wsgi [None req-598fe763-25be-431e-9e06-c62a926fa1da tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] HTTP exception thrown: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-598fe763-25be-431e-9e06-c62a926fa1da tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Request method failure captured: May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: request: DELETE /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb HTTP/1.1 May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept: application/json May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Accept-Encoding: identity May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Connection: close May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Length: 0 May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Content-Type: application/json May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Host: 10.222.0.24 May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Openstack-System-Scope: None May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: User-Agent: python-urllib3/1.26.9 May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Auth-Token: gAAAAABigqJf3RbHQYJhmEptKp0cS0QguIxgNpF161dv1ZMYhO7NnbLclJBZ8JyvVydLvuEe0Bt0rjKelXzGJkrgFrx-L6AK9uLlS4H6jbcsmD5GSJP7ikjeTqYhpbhwhn1ujqcJC65gj-9zdrNvI0_fQlah583iAhEi71CSp_RyTQ5llGG6lys May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Id: None May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Domain-Name: None May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Identity-Status: Confirmed May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Is-Admin-Project: True May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Id: default May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Domain-Name: Default May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Id: 385ae3c7ea8347d7bfc346d8bc7fda4a May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Project-Name: tempest-TestVolumeBootPattern-1099673589 May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Role: reader,member May 16 19:20:49.642381 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Roles: reader,member May 16 19:20:49.644063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:20:49.644063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant: tempest-TestVolumeBootPattern-1099673589 May 16 19:20:49.644063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Id: 385ae3c7ea8347d7bfc346d8bc7fda4a May 16 19:20:49.644063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-Tenant-Name: tempest-TestVolumeBootPattern-1099673589 May 16 19:20:49.644063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User: tempest-TestVolumeBootPattern-1099673589-project May 16 19:20:49.644063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Id: default May 16 19:20:49.644063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Domain-Name: Default May 16 19:20:49.644063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Id: 64634c902a884b84a8bd2d3c10ce6270 May 16 19:20:49.644063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: X-User-Name: tempest-TestVolumeBootPattern-1099673589-project May 16 19:20:49.644063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: method: > May 16 19:20:49.644063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: exception: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. May 16 19:20:49.644063 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: action_args: {'id': '9b3e480e-c9ee-46ba-8393-c289b3fee9eb'} May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:20:49.645678 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. May 16 19:20:49.647737 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: ERROR nova.api.openstack.wsgi May 16 19:20:49.649293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-598fe763-25be-431e-9e06-c62a926fa1da tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Returning 404 to user: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. {{(pid=117274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:20:49.649293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-598fe763-25be-431e-9e06-c62a926fa1da tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 404 len: 111 microversion: 2.1 time: 0.030176 May 16 19:20:49.649293 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 621/1202] 10.222.0.24 () {58 vars in 1238 bytes} [Mon May 16 19:20:49 2022] DELETE /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:20:49.653513 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4edb780c-d36e-48ef-aac2-788197944614 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '>' {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:20:49.654165 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.compute.api [None req-4edb780c-d36e-48ef-aac2-788197944614 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] [instance: 9b3e480e-c9ee-46ba-8393-c289b3fee9eb] Fetching instance by UUID {{(pid=117275) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 19:20:49.660702 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4edb780c-d36e-48ef-aac2-788197944614 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:49.661146 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4edb780c-d36e-48ef-aac2-788197944614 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:49.661945 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4edb780c-d36e-48ef-aac2-788197944614 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 19:20:49.662371 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG oslo_concurrency.lockutils [None req-4edb780c-d36e-48ef-aac2-788197944614 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Lock "fd853ee5-c8a0-4547-ae1e-d1c83abe0d3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 19:20:49.676005 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.wsgi [None req-4edb780c-d36e-48ef-aac2-788197944614 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] HTTP exception thrown: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4edb780c-d36e-48ef-aac2-788197944614 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Request method failure captured: May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: request: GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb HTTP/1.1 May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept: application/json May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Accept-Encoding: identity May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Connection: close May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Length: 0 May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Content-Type: application/json May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Host: 10.222.0.24 May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Openstack-System-Scope: None May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: User-Agent: python-urllib3/1.26.9 May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Auth-Token: gAAAAABigqJf3RbHQYJhmEptKp0cS0QguIxgNpF161dv1ZMYhO7NnbLclJBZ8JyvVydLvuEe0Bt0rjKelXzGJkrgFrx-L6AK9uLlS4H6jbcsmD5GSJP7ikjeTqYhpbhwhn1ujqcJC65gj-9zdrNvI0_fQlah583iAhEi71CSp_RyTQ5llGG6lys May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Id: None May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Domain-Name: None May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Identity-Status: Confirmed May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Is-Admin-Project: True May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Id: default May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Domain-Name: Default May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Id: 385ae3c7ea8347d7bfc346d8bc7fda4a May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Project-Name: tempest-TestVolumeBootPattern-1099673589 May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Role: reader,member May 16 19:20:49.677493 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Roles: reader,member May 16 19:20:49.679112 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_385ae3c7ea8347d7bfc346d8bc7fda4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}] May 16 19:20:49.679112 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant: tempest-TestVolumeBootPattern-1099673589 May 16 19:20:49.679112 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Id: 385ae3c7ea8347d7bfc346d8bc7fda4a May 16 19:20:49.679112 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-Tenant-Name: tempest-TestVolumeBootPattern-1099673589 May 16 19:20:49.679112 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User: tempest-TestVolumeBootPattern-1099673589-project May 16 19:20:49.679112 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Id: default May 16 19:20:49.679112 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Domain-Name: Default May 16 19:20:49.679112 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Id: 64634c902a884b84a8bd2d3c10ce6270 May 16 19:20:49.679112 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: X-User-Name: tempest-TestVolumeBootPattern-1099673589-project May 16 19:20:49.679112 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: method: > May 16 19:20:49.679112 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: exception: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. May 16 19:20:49.679112 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: action_args: {'id': '9b3e480e-c9ee-46ba-8393-c289b3fee9eb'} May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: {{(pid=117275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 19:20:49.679895 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. May 16 19:20:49.681161 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: ERROR nova.api.openstack.wsgi May 16 19:20:49.682748 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: DEBUG nova.api.openstack.wsgi [None req-4edb780c-d36e-48ef-aac2-788197944614 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Returning 404 to user: Instance 9b3e480e-c9ee-46ba-8393-c289b3fee9eb could not be found. {{(pid=117275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 19:20:49.682748 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO nova.api.openstack.requestlog [None req-4edb780c-d36e-48ef-aac2-788197944614 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb" status: 404 len: 111 microversion: 2.1 time: 0.029396 May 16 19:20:49.682748 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: [pid: 117275|app: 0|req: 582/1203] 10.222.0.24 () {58 vars in 1235 bytes} [Mon May 16 19:20:49 2022] GET /compute/v2.1/servers/9b3e480e-c9ee-46ba-8393-c289b3fee9eb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 19:20:50.982229 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: DEBUG nova.api.openstack.wsgi [None req-e6acc7ec-4b11-4c9f-9412-9656ce857841 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] Calling method '.version_select at 0x7f1e19013f70>' {{(pid=117274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 19:20:51.006506 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO nova.api.openstack.requestlog [None req-e6acc7ec-4b11-4c9f-9412-9656ce857841 tempest-TestVolumeBootPattern-1099673589 tempest-TestVolumeBootPattern-1099673589-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1176123874" status: 202 len: 0 microversion: 2.1 time: 0.028106 May 16 19:20:51.007156 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: [pid: 117274|app: 0|req: 622/1204] 10.222.0.24 () {58 vars in 1262 bytes} [Mon May 16 19:20:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1176123874 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 19:21:30.480532 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:21:30.481368 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Mon May 16 19:21:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:21:55.019089 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:21:55.020312 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Mon May 16 19:21:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:23:09.466647 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:23:09.467528 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Mon May 16 19:23:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:23:30.720274 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:23:30.721017 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Mon May 16 19:23:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:23:36.189806 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:23:36.190296 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Mon May 16 19:23:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:23:38.015646 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:23:38.016645 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Mon May 16 19:23:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:24:50.494029 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:24:50.494972 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Mon May 16 19:24:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:25:15.033957 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:25:15.035048 dv-cinder-766064-6-iscsi devstack@n-api.service[117275]: Mon May 16 19:25:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 19:26:29.480204 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 19:26:29.481118 dv-cinder-766064-6-iscsi devstack@n-api.service[117274]: Mon May 16 19:26:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!